AD-A169  689 


*  rjt i  rw  'w.nx  rj^ 


./  *-*V 


(Z 


.  •  *...■•»  • 
•  .  •.*  .  . 


Research  Product  84-20 


HUMAN  RESOURCES  TEST 
AND  EVALUATION  SYSTEM  (HRTES) 
VOLUME  2:  SUPPLEMENT 


ARI  Field  Unit  at  Fort  Hood,  Texas 
Systems  Research  Laboratory 


August  1984 


OTIC: 

jE'-ECTEI 

JUL 1  7  1988 


E 


U.S.  ARM Y  RESEARCH  INSTITUTE  lor  the  BEHAVIORAL  and  SOCIAL  SCIINCE^  i  7 

86  ?  16  1)1 


£r:£;&tor.Y::^ 


.XS3U.M 


u.  S.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

A  Field  Operating  Agency  under  the  Jurisdiction  of  the 
Deputy  Chief  of  Staff  for  Personnel 


EDGAR  M.  JOHNSON 
Technical  Director 


L.  NEALE  COSBY 
Colonel,  IN 
Commander 


Research  accomplished  under  contract 
for  the  Department  of  the  Army 

Perceptronics ,  Inc. 


Accession  For 
NITS  nhAkl 

dtic  tap  Sq 

Unnunc  m  j  cd  j-n 

Justlf  lent  i0  u _ _ 

By - - - 

Distribution/ 

Availability  Codes" 
(Avail  and/or 
lst  |  Special 


M 


FINAL  DISPOSITION!  Thl»  R*M«fcD  Product  may  t>a  daitroyad  whin  It  It  no  looter  n»«d*d.  Pmim  OO  not 
return  It  to  tha  U.S.  Army  RiwircB  Institute  tor  tht  0«h«vloril  and  Social  Scimc*i. 


NOTE;  This  Rasaarch  Product  ft  not  to  b«  construed  as  an  official  Oapartmant  of  tha  Army  documant  In  ttt 
peasant  form. 


StCUBtTV  CL  ASM*  tC  ATjOm  0«  TmiS  '*••»»«  /»-«- 


REPORT  DOCUMENTATION  PAGE 


I  .  RE  PO« T  HUMMER 

ARI  Research  Product  84-20 


HI  A[)  INSTRUCTIONS 
IIKI-ORK  COMI’I.IITINC.  SOKM 


)  HfdPlfNT'S  C*T»tOC  homHER 


S  T  y  I  *  f  O*  M|  PO»T  A  Pf'RlOO  r  OVfHffl 

Final 

Period  endinq  May  1982 


6  PlRtOBMIMC  one.  REPORT  MUMPER 

Hone 


7.  AUTHORS 

Jonathan  D.  Kaplan  (ARI),  Norman  D.  Schwalm,  & 
William  H.  Crooks  (Perceptronics ) 

B.  CONTRACT  OR  GRANT  NUMBER*) 

DAHC-19-77-C-0055 

».  PERFORMING  ORGANIZATION  NAME  ANO  AOORESS 

Perceptronics 

6271  Variel  Avenue 

Woodland  Hills,  CA  91367 

10.  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  6  WORK  UNIT  NUMBERS 

Program  Element  2Q263739A793 
Task  3229  Work  Unit  53 

II.  CONTROLLING  OFFICE  NAME  ANO  AOORESS 

12.  REPORT  OATE 

U.S.  Army  Research  Institute  for  the  Behavioral 

August  1984 

and  Social  Sciences 

11  NUMBER  OF  PAGES 

5001  Eisenhower  Avenue,  Alexandria,  VA  22333-5600 

297 

.  MONITORING  AGENCY  NAME  a  AOORESV*/  Irom  Controlling  OIUco) 


15.  SECURITY  CLASS,  (ol  thlm  rmpon) 

Unclassified 


IS«  OECL  ASSIFiCATlON/OOWNGRAOiNG 

schedule 


16.  OISTRI8UTION  STATEMENT  (ol  thlm  (import) 


Approved  for  public  release;  distribution  unlimited 


17.  DISTRIBUTION  STATEMENT  (of  thm  mbmtrmct  mntmrmd  In  Block  70.  U  dlllmrtnt  Irom  RmfHfrt) 


18.  SUPPLEMENTARY  NOTES 


K  c !  _ _ 

1,.  KEY  WORDS  (Continue  on  roeoroo  tide  II  ntcottory  end  Identity  by  block  number) 

Human  performance  Test  and  evaluation 

Human  factors  Human  resources 

Human  factors  engineering  ^ — ^Training  evaluation  t  >- 

^ Operational  testing ) 


10.  AKTOACT  CCoertkmte  on  roe ereo  eldm  II  neceeeery  mad  Identity  by  block  number) 

vThe  Human  Resources  Test  and  Evaluation  System  (HRTES)  is  a  set  of  pro¬ 
cedures  designed  to  assist  a  test  planner  in  evaluating  the  operator  and 
maintainer  performance  in  an  operational  test  of  an  Army  system.  Specifically, 
HRTES  provides  guidance  for  (1)  identifying  the  critical  aspects  of  human 
performance  to  be  included  in  the  operational  test,  (2)  evaluating  that  per¬ 
formance,  and  (3)  analyzing  the  cause(s)  of  any  inadequate  human  performance. 
Guidance  is  also  provided  for  identifying  the  contributions  of  (Continued) 


00  1473  COITION  OF  I  MOW  *S  IS  OBSOLCTC 


_ UNCLASSIFIED 

security  cl ASSiriC atioh  op  this  rage  (■ 


Dmtm  Entmro*) 


•  T-*  5  ' 


unclass r r n  fi  _ _ 

IICU>I<<  Cl  »»»!'  1C  »  t  ioh  or  T«n  r  A  P-<«  *"'* 


AR I  Research  Product  84-20 


20.  (Continued) 

^training,  personnel  selection,  and  human  factors  engineering  to  overall 
human  performance.  This  volume  includes  detailed  descriptions  of  a  num¬ 
ber  of  the  test  procedures  and  methods  outlined  in  Volume  1  -  Test  Pro¬ 
cedures.  It  also  presents  alternate  methods  for  performing  some  of  the 
steps . 


V  £tm D  /  7 


_ UNCLASS  I  F_I_  CD _ 

1  1  %fC»J"»T*CL*Sli*'CATio*0*  *  M1  '  *  A  01  (»' f 


Research  Product  84-20 


HUMAN  RESOURCES  TEST 
AND  EVALUATION  SYSTEM  (HRTES) 
VOLUME  2:  SUPPLEMENT 

Jonathan  D.  Kaplan 
Army  Research  Institute 

Norman  D.  Schwalm  and  William  H.  Crooks 
Perceptronics,  Inc. 


Submitted  by 

George  M.  Gividen,  Chief 
ARI  Field  Unit  at  Fort  Flood,  Texas 


Approved  as  technically  adequate 
and  submitted  for  publication  by 
Jerrold  M.  Levine,  Director 
Systems  Research  Laboratory 


U.S.  ARMY  RESEARCH  INSTITUTE  FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 
5001  Eisenhower  Avenue,  Alexandria,  Virginia  22333 

Office,  Deputy  Chief  of  Staff  for  Personnel 
Department  of  the  Army 

August  1984 


Army  Project  Number  Human  Factors  in  Training  & 

2Q283739A7932Q  Operational  Effectiveness 


Approved  (or  public  releete;  d'ftnbution  unlimited. 


ARI  Research  Reports  and  Technical  Reports  are  intended  for  sponsors  of 
R&D  tasks  and  for  other  research  and  military  agencies.  Any  findings  ready 
for  implementation  at  the  time  of  publication  are  presented  in  the  last  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recom¬ 
mendations  for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


FOREWORD 


Because  of  their  complexity,  weapons  and  other  systems  being  acquired  by 
the  Army  will  place  heavy  demands  on  operator  and  maintenance  personnel.  To 
avoid  costly  failures,  the  human  resources  aspects  of  these  future  systems 
must  be  fully  evaluated  early  in  their  development  cycles,  so  that  problems 
can  be  corrected  prior  to  full-scale  production.  However,  the  Army  does  not 
have  enough  personnel  with  human  factors  expertise  to  staff  all  of  the  system 
tests  conducted  each  year.  Personnel  with  little  or  no  training  or  experience 
in  the  human  factors  area  must  often  be  assigned  to  conduct  these  evaluations. 
The  Human  Resources  Test  and  Evaluation  System  (HRTES)  was  designed  to  meet 
the  need  for  a  guidance  document  to  aid  the  "typical"  test  officer  in  planning 
and  conducting  human  resources  evaluations  of  proposed  Army  equipment. 
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EXECUTIVE  SUMMARY 
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Weapons  and  other  systems  being  acquired  by  the  Army  are  becoming  in¬ 
creasingly  complex  and  costly,  and  place  ever  increasing  demands  on  operator 
and  maintenance  personnel.  Recent  data  suggest  that  these  personnel  are  re¬ 
sponsible  for  over  one-half  of  the  failures  of  major  systems.  Therefore,  it 
is  imperative  that  the  human  resources  aspects  of  future  systems  be  fully 
evaluated  early  in  the  development  cycle,  and  that  problems  be  corrected 
prior  to  full-scale  production.  However,  the  Army  does  not  have  adequate 
numbers  of  personnel  with  human  factors  expertise  to  man  all  of  the  system 
tests  conducted  each  year.  As  a  result,  personnel  with  little  or  no  train¬ 
ing  or  experience  in  the  human  factors  area  must  often  be  assigned  to  conduct 
human  factors  evaluations.  Therefore,  there  is  an  obvious  need  for  guidance 
documents  to  aid  the  "typical"  test  officer  plan  and  conduct  human  resources 
evaluations  of  Army  equipment.  The  Human  Resources  Test  and  Evaluation  Sys¬ 
tem  (HRTES)  was  designed  to  meet  this  need. 


Procedure: 

In  developing  HRTES,  it  was  assumed  that  the  primary  purpose  of  tests 
and  evaluations  was  to  determine  whether  the  tested  systems  were  able  to 
satisfy  the  requirements  for  whi ch  they  were  developed.  Given  this  assump¬ 
tion,  procedures  were  developed  to  focus  first  on  identifying  those  activi¬ 
ties  or  functions  a  system  must  perform.  Since  the  emphasis  in  HRTES  was 
to  be  on  the  human  components  of  a  system,  procedures  were  then  developed 
to  identify  those  human  activities  which  must  be  performed  for  the  system 
as  a  whole  to  perform  its  functions.  Next,  procedures  were  developed  to 
determine  what  aspects  of  human  performance  had  to  be  measured.  Finally, 
procedures  were  developed  for  analyzing  the  cause(s)  of  any  inadequate  per¬ 
formance.  This  latter  guidance  was  designed  to  aid  the  test  officer  in 
identifying  the  contributions  of  training,  personnel  selection,  and  human 
factors  engineering  to  overall  human  performance. 

Volume  1  of  HRTES,  titled  TEST  PROCEDURES,  is  the  primary  guidance 
document.  It  describes  the  steps  to  be  taken  in  performing  each  of  the 
major  tasks.  Volume  2,  titled  SUPPLEMENT,  contains  detailed  descriptions 
of  a  number  of  the  test  procedures  and  methods.  Thus,  the  supplement  can 
be  considered  to  be  an  appendix  to  the  Test  Procedures  volume. 


HRTES 


Human  Resources  Test  and  Evaluation  System 


CONTENTS 

1.  INTRODUCTION . Sl-1 

2.  IDENTIFYING  TEST  ISSUES  . S2-1 

3.  PROCEDURE  FOR  PERFORMANCE  TESTING  .  S3-1 

4.  COLLECTING  ADDITIONAL  DATA  DURING  OT  .  S4-1 

5.  EVALUATION . S5-1 

6.  ANALYSIS . S6-1 
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S  2.1  Developing  Test  Issues 


This  section  provides: 

(1)  A  "System  Class  Index"  that  describes  the  type  of  Army 
system  for  which  the  operational  test  is  being  prepared,  and 

(2)  A  list  of  test  issues  that  applies  to  each  system  class. 

The  procedure  for  developing  test  issues: 

(1)  Refer  to  the  System  Class  Index  and  determine  the  system 
class  that  applies  to  the  Army  system  to  be  tested. 

(2)  Turn  to  the  page  in  this  section  that  is  referenced  by 
the  system  class  index  for  the  Army  system  to  be  tested. 

(3)  Review  the  issues  contained  in  the  list  for  the  Army 
system  to  be  tested. 


(4)  Determine  which  issues  you  feel  should  be  tested  for  this 


SYSTEM  CLASS  INDEX 


) 

SYSTEM  CLASS  PAGE 

1.  Air  Defense  Weapons . S  2-3 

2.  Armored  Vehicles . S  2-5 

3.  Aviation  Systems .  S  2-7 

4.  Battlefield  Comnuni cations  Systems . S  2-9 

5.  C3/C3I  Systems . S  2-10 

6.  Combat/Tactical  Support  Equipment  .  S  2-12 

7.  Electronic  Warfare  and  Surveillance  Systems  .  S  2-14 

8.  Ground  Transportation  Equipment  .  S  2-16 

9.  Infantry  Weapons .  S  2-17 

10.  Ordnance  Systems .  S  2-18 

11.  Target  Acquisition  and/or  Designator  Systems .  s  2-20 


SYSTEM  CLASS  1  -  AIR  DEFENSE  WEAPONS 
Including : 

Short  Range  Missiles,  Medium  Range  Missiles 
Air  Defense  Guns,  High  Energy  Systems 


HOW  EFFECTIVELY  CAN  THE  SYSTEM: 

1.  Destroy  aircraft? 

2.  Confuse  and  disrupt  aircraft? 

3.  Deny  selected  airspace/formation  to  attacking  aircraft? 

4.  Destroy  ground  targets? 

5.  Acquire  its  targets? 

6.  Deliver  its  ammunition  on  the  target/target  area? 

7.  Engage  several  targets,  simultaneously? 

8.  Navigate? 

9.  Maneuver  in  travel? 

10.  Engage  in  self-recovery? 

11.  Prevent  its  detection  and  accurate  location? 

12.  Operator(s)/troops  escape? 

13.  Protect  its  operator(s)/troops/material  from  small  arms  fire 
minimize  the  effects  of  major  weapon  fire? 

14.  Be  moved,  between  operations,  to  minimize  the  probability  of 
detecti on/1 ocati on  ? 

15.  Represent  weather? 

16.  Represent  the  status  of  forces? 


17.  Project  weather  conditions? 

18.  Select  and  order  targets  for  attack? 

19.  Manage  weapon  functions? 

20.  Recommend  logistics  procedures? 

21.  Select  the  most  appropriate  friendly  forces  to  engage  in  an  operation? 

22.  Establish/maintain  conmunications  between  organizational  nodes? 

23.  Prevent  interception/jamming  of  its  communications? 

24.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 

25.  Deliver  the  troops/material  in  fully  operable  condition? 

26.  Be  loaded/unloaded  with  troops/applicable  material/fuel /ammunition? 

27.  Be  transported? 
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SYSTEM  CLASS  2  -  ARMORED  VEHICLES 
I nc 1 udi ng : 

Main  Battle  Tanks,  Armored  Reconnaissance  Vehicles/ 
Light  Tanks,  Infantry/Caval ry  Fighting  Vehicle 
Armored  Personnel  Carriers/Mounting,  Anti-Tank  Weapons 


1.  Destroy  fixed  emplacements? 

2.  Destroy  armored  vehicles? 

3.  Destroy  enemy  personnel? 

4.  Destroy/disrupt  enemy  aircraft? 

5.  Suppress/disrupt  enemy  activity? 

6.  Serve  as  a  platform  for  mounted  attack? 

7.  Deliver  its  ammunition  on  the  target/target  area? 

8.  Acquire  its  targets? 

9.  Engage  several  targets, 

10.  Navigate? 

11.  Maneuver  in  travel? 

12.  Maneuver  in  attack/defense? 

13.  Engage  in  self-recovery? 

14.  Prevent  its  detection  and  accurate  location? 

15.  Operator(s)  and  troop(s)  escape? 

16.  Protect  its  operator(s)  troops/  materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 
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17.  Be  moved,  between  operations,  to  minimize  the  probability  of 
detection/location? 

18.  Gather  appropriate  information? 

19.  Engage  in  fire  control? 

20.  Recover  a  disabled  vehicle? 

21.  Remove/breach  obstacles? 

22.  Bridge  an  obstacle? 

23.  Establ ish/maintain  communications 

24.  Prevent  interception/ jamming  of  its  conmunications? 

25.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organi zation? 

26.  Deliver  the  troops/materiel  in  fully  operable  condition? 

27.  Be  loaded/unloaded  with  troops/appl icable  materiel/fuel/ammunition/ 
wounded  personnel? 

28.  How  effectively  can  the  system  be  transported? 


SYSTEM  CLASS  3  -  AVIATION  SYSTEMS 


Including: 

Attack  Helicopters,  Scout  Helicopters, 
Transport  Helicopters,  Utility  Helicopters, 
Fixed-Wing  Reconnaissance,  Fixed-Wing  Transport 


1.  Destroy  enemy  vehicles? 

2.  Destroy  anti-aircraft  systems? 

3.  Destroy  fixed  emplacements? 

4.  Destroy  enemy  personnel? 

5.  Disrupt/suppress  enemy  activity? 

6.  Serve  as  platform  for  electronics  warfare  systems? 

7.  Transport  troops/materiel? 

8.  Transport  injured  troops? 

9.  Acquire  its  targets? 

10.  Deliver  its  ammunition  on  the  target/target  area? 

11.  Engage  several  targets,  simultaneously? 

12.  Navigate? 

13.  Maneuver  in  travel? 

14.  Maneuver  in  attack/defense? 

15.  Prevent  its  detection  and  accurate  location? 

16.  Qperator(s)/troop(s)  escape? 


HOW  EFFECTIVELY  CAN  THE  SYSTEM 
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17.  Protect  its  operator(s)/troops/materie1  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 

18.  Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 

19.  Deliver  the  troops/materiel  in  fully  operable  condition? 

20.  Be  loaded/unloaded  with  troops/applicable  materiel /fuel /ammunition/ 
wounded  personnel? 

21.  Establish/maintain  communications  between  organizational  nodes? 

22.  Prevent  interception/jamming  of  its  communications? 

23.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 

24.  Gather  appropriate  information? 

25.  Engage  in  fire  control? 

26.  Be  transported? 
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SYSTEM  CLASS  4  -  BATTLEFIELD  COMMUNICATION  SYSTEMS 

Including: 

Man-Portable  Radios,  Vehicle-Portable  Radios, 
Visual  Corrounications  Systems,  and  Base  Radio  Systems 


HOW  EFFECTIVELY  CAN  THE  SYSTEM: 


1.  Transfer  information  and  orders  between  concerned  units/individuals? 

2.  Navigate? 

3.  Maneuver  in  travel? 

4.  Engage  in  self-recovery? 

5.  Prevent  its  detection  and  accurate  location? 

6.  Operator(s)/troops  escape? 

7.  Protect  its  operator(s)/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 

8.  Be  moved,  between  operations,  to  minimize  the  probability  of 
detection/location? 

9.  Establish/maintain  communications  between  organizational  nodes? 

10.  Prevent  interception/jamming  of  its  communications? 

11.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 

12.  Be  transported? 
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SYSTEM  CLASS  5  -  C3  AND  C3I  SYSTEMS 
Including: 

Field  Artillery  Fire  Control,  Tank  Fire 
Control,  Air  Defense  Fire  Control 


HOW  EFFECTIVELY  CAN  THE  SYSTEM: 


Provide  information  on  current  battlefield  conditions  and  enemy 
behavior? 

Provide  projections  of  probable  future  conditions  and  enemy  behavior? 
Control  the  behavior  of  friendly  forces? 

Manage  friendly  weapon  operation? 

Manage  logistics? 

Communicate  information  to  appropriate  units? 

Acquire  its  targets? 

Prevent  its  detection  and  accurate  location? 

Operator(s)/troops  escape? 

Protect  its  operator(s)/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 

Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 

Represent  terrain/obstacles/instal lations/weather? 

Represent  the  status  of  forces? 

Gather  appropriate  information? 

Engage  in  fire  control? 

Engage  several  targets,  simultaneously? 
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17.  Project  battlefield  operations? 

18.  Project  weather  conditions? 

19.  Select  and  order  targets  for  attack? 

20. '  Manage  weapon  functions? 

21.  Prepare  personnel  plans? 

22.  Recommend  logistics  procedures? 

23.  Select  the  most  appropriate  friendly  forces  to  engage  in  an  operation 

24.  Control  friendly  forces  on  the  battlefield. 

25.  Establish/maintain  communications  between  organizational  nodes? 

26.  Prevent  intercept!' on/ jamning  of  its  communications? 

27.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 


28.  Be  transported? 


SYSTEM  CLASS  6  -  COMBAT /TACT I CAL  SUPPORT  EQUIPMENT 

Including: 

Combat  Engineer  Vehicles,  Recovery  Vehicles, 
Demolition  Equipment,  and  Bridging  Equipment 


1.  Destroy/remove  obstacles/roadblocks/access  ways? 

2.  Bridge  obstacles? 

3.  Construct  emplacement/shelters? 

4.  Transport  comnand  posts? 

5.  Transport  damaged  vehicles? 

6.  Destroy  armored  vehicles/personnel /thi n  skinned  vehicles? 

7.  Acquire  its  targets? 

8.  Deliver  its  ammunition  on  the  target/target  area? 

9.  Engage  several  targets,  simultaneously? 

10.  Navigate? 

11.  Maneuver  in  travel? 

12.  Maneuver  in  attack/defense? 

13.  Engage  in  sel f- recovery? 

14.  Prevent  its  detection  and  accurate  location? 

15.  Operator (s )/troops  escape? 

16.  Protect  its  operator (s)/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 

17.  Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 


L8.  Recover  a  disabled  vehicle? 

L9.  Deliver  the  troops/materiel  in  fully  operable  condition? 

20.  Be  loaded/unloaded  with  troops/applicable  materiel/fuel/ammunition/ 
wounded  personnel? 

21.  Establish/maintain  communications  between  organizational  nodes? 

22.  Prevent  interception/j aiming  of  its  communications? 

23.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 

24.  Be  transported? 
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SYSTEM  CLASS  7  -  ELECTRONIC  WARFARE  AND  SURVEILLANCE  SYSTEMS 

Including: 

Countermeasures  Equipment  and 
Sighting  and  Surveillance  Equipment 

HOW  EFFECTIVELY  CAN  THE  SYSTEM: 

1.  Jam  electronic  signals? 

2.  Produce  false  targets/target  signatures? 

3.  Provide  critical  information  on  potential  targets? 

4.  Confuse/disrupt/disable  enemy  systems? 

5.  Acquire  its  targets? 

6.  Gather  the  appropriate  information  about  the  targets  and  interpret 
that  information  into  meaningful  data? 

7.  Predict  target  behavior? 

8.  Designate  the  appropriate  targets? 

9.  Deliver  the  troops/materiel  in  fully  operable  condition? 

10.  Be  loaded/unloaded  with  troops/applicable  material/fuel/ammunition/ 
wounded  personnel? 

11.  Navigate? 

12.  Maneuver  in  travel? 

13.  Maneuver  in  attack/defense? 

14.  Engage  in  self- recovery? 

15.  Prevent  its  detection  and  accurate  location? 

16.  Operator (s)/troops  escape? 

17.  Protect  its  operator (s )/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 


Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 


Establish/maintain  communications  between  organizational  nodes? 

Prevent  interception/jamming  of  its  communications? 

Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organi zation? 

Engage  in  fire  control? 

Be  transported? 
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SYSTEM  CLASS  8  -  GROUND  TRANSPORTATION  EQUIPMENT 

Including: 

1/4  Ton  Utility  Trucks,  3/4  to  1}  Ton  Trucks,  5  Ton 
Trucks,  8  to  10  Ton  Trucks,  Heavy  Equipment  Transport  Trucks 


HOW  EFFECTIVELY  CAN  THE  SYSTEM: 


1.  Transport  command  personnel? 

2.  Navigate? 

3.  Maneuver  in  travel? 

4.  Maneuver  in  defense? 

5.  Engage  in  sel f- recovery? 

6.  Prevent  its  detection  and  accurate  location? 

7.  Operator (s)/troops  escape? 

8.  Protect  its  operator(s)/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 

9.  Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 

0.  Deliver  the  troops/materiel  in  fully  operable  condition? 

1.  Be  loaded/unloaded  with  troops/appicable  materiel /fuel /ammuntion/ 
wounded  personnel? 

2.  Establish/maintain  communications  between  organizational  nodes? 

3.  Prevent  interception/jamming  of  its  communications. 

4.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 


5.  Be  transported? 


SYSTEM  CLASS  9  -  INFANTRY  WEAPONS 


Including: 


Pistols/Revolvers,  Rifles,  Sub-Machine  Guns,  Machine 
Guns,  Recoilless  Rifles,  Anti-Tank  Missile  Systems, 
Grenades/Grenade  Launchers,  Anti -Armor  Mines, 
Anti-Personnel  Mines,  Flamethrowers,  Mortars 


HOW  EFFECTIVELY  CAN  THE  SYSTEM: 


1.  Destroy  enemy  vehicles? 

2.  Destroy  low  flying  enemy  aircraft? 

3.  Destroy  fixed  emplacements? 

4.  Destroy  enemy  troops? 

5.  Disrupt/suppress  enemy  activity? 

6.  Provide  i 1 limi nation? 

7.  Conceal  friendly  forces  by  making  smoke? 

8.  Acquire  its  targets? 

9.  Deliver  its  ammunition  on  the  target/target  area? 

10.  Engage  several  targets,  simultaneously? 

11.  Prevent  its  detection  and  accurate  location? 

12.  Protect  its  operator(s)/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 

13.  Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 


14.  Be  transported? 


SYSTEM  CLASS  10  -  ORDNANCE  SYSTEMS 
Includi ng : 

Light,  Towed,  Tube  Artillery;  Light,  Self-Propelled,  Tube  Artillery; 
Medium,  Towed,  Tube  Artillery;  Mediun  Self-Propelled,  Tube  Artillery; 
Heavy,  Self-Propelled  Tube  Artillery;  Battlefield  Support  Guided 
Missile;  Battlefield  Support  Unguided  Missiles;  Multiple  Launch, 
Guided  Missiles;  Multiple  Launch,  Unguided  Missiles 


1.  Destroy  fixed  emplacements  on  or  behind  the  battlefield? 

2.  Destroy  enemy  vehicles/weapons? 

3.  Destroy  enemy  personnel? 

4.  Suppress/deny  enemy  activity,  and  deny  terrain  to  enemy? 

5.  Provide  i 1 luni nation? 

6.  Conceal  friendly  forces  by  making  smoke? 

7.  Acquire  its  targets? 

8.  Deliver  its  ammunition  on  the  target/target  area? 

9.  Engage  several  targets,  simultaneously? 

10.  Navigate? 

11.  Maneuver  in  travel? 

12.  Maneuver  in  attack/defense? 

13.  Engage  in  self-recovery? 

14.  Prevent  its  detection  and  accurate  location? 

15.  Operator (s)/troops  escape? 

16.  Protect  its  operator(s)/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 
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17.  Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 

18.  Deliver  the  troops/materiel  in  fully  operable  condition? 

19.  Be  loaded/unloaded  with  troops/applicable  materiel/fuel/ammunition/ 
wounded  personnel? 

20.  Establish/maintain  communications  between  organizational  nodes? 

21.  Prevent  interception/ jamming  of  its  communications? 

22.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 

23.  Be  transported? 
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SYSTEM  CLASS  11  -  TARGET  ACQUISITION  AND/OR  DESIGNATOR  SYSTEMS 


HOW  EFFECTIVELY  CAN  THE  SYSTEM: 

1.  Acquire  its  targets? 

2.  Gather  the  appropriate  information  about  the  targets  and  interpret 
that  information  into  meaningful  data? 

3.  Predict  target  behavior? 

4.  Designate  the  appropriate  targets? 

5.  Prevent  its  detection  and  accurate  location? 

6.  Protect  its  operator(s)/troops/materiel  from  small  arms  fire  and 
minimize  the  effects  of  major  weapon  fire? 

7.  Be  moved,  between  operations,  to  minimize  the  probability  of  detection/ 
location? 

8.  Deliver  the  troops/materiel  in  fully  operable  condition? 

9.  Be  loaded/unloaded  with  troops/applicable  materiel/fuel/ammunition/ 
wounded  personnel? 

10.  Establish/maintain  communications  between  organizational  nodes? 

11.  Prevent  interception/jamming  of  its  comnunications? 

12.  Identify  and  route  output  to  the  most  appropriate  nodes  of  the 
organization? 

13.  Gather  appropriate  information? 

14.  Engage  in  fire  control? 

15.  Be  transported? 
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S  2.2  Developing  Scope 
This  section  provides: 

(1)  A  "Scope  Category  Index"  that  describes  the  categories 
of  scope  that  relate  to  issues  to  be  tested,  and 

(2)  A  list  of  conditions  that  make  up  each  scope  category. 
The  procedure  for  developing  scope  is: 

(1)  Refer  to  the  Scope  Category  Index  and  determine  which 
categories  apply  to  the  issues  to  be  tested. 

(2)  Turn  to  the  page  in  this  section  that  is  referenced 
by  the  Scope  Category  Index. 

(3)  Review  the  conditions  (scope)  in  the  selected  scope 
categories. 

(4)  Determine  the  conditions  which  you  feel  should  make  up 
the  scope  for  the  issues  you  have  previously  selected. 
This  may  be  aided  by  preparing  a  matrix  of  operational 
issues  by  conditions. 
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SCOPE  CATEGORY  INDEX 


SCOPE 

CATEGORY 

PAGE 

1.  WEATHER . 

.  S  2-23 

A. 

Illumination 

R. 

Temperature 

C. 

Precipitation 

D. 

Wind 

E. 

Hunldlty 

2.  TERRAIN  . 

.  S  2-24 

A. 

Ground  Slope 

B. 

Ground  Surface 

C. 

Ground  and  Water  Surface 

D. 

Obstacles 

3.  TARGET . . 

.  S  2-25 

A. 

Type 

B. 

Nianber 

C. 

Location 

D. 

Speed 

E. 

Direction  of  Motion 

P. 

Concealment 

4.  PERSONNEL  . 

.  S  2-26 

A. 

Workload 

B. 

Duration  of  Preceding  Work 

C. 

Protective  Gear 

D. 

Physical  Strength 

E. 

Perceptual  Ability 

F. 

Experience 

G. 

Aptitudes 

H. 

Physical  Size 

5.  TRAINING  . 

.  S  2-27 

A. 

Institution 

B. 

Latency 

C. 

Team  vs.  Individual 

6.  OPERATIONAL . 

.  S  2-28 

A. 

Crew  . 

B. 

Hardware 

C. 

Information  Inputs 

7.  TACTICS  . 

.  S  2-29 

A. 

Ninber  of  Systems  Employed 

B. 

Speed 

C. 

Location 

0. 

Direction  of  Motion 

E. 

Concealment 

F. 

Crew  Protection 

G. 

Amount  of  Automatic  Functioning 

H. 

System  Workload 

SCOPE  CATEGORY:  1.  WEATHER 

A.  ILLUMINATION 


Full  Sunlight 
Moonl ight 
Starlight 
Dusk 

Overcast,  Moonless  Night  (Pitch  Black) 

Artificial  Lighting 

Flares 

Direct  Glare 

Indirect  Glare  (Water,  Sand,  Clouds,  etc.) 


B.  TEMPERATURE 


High 

Low 

Normal 


C.  PRECIPITATION 


[  (1)  Rain 

_  (2)  F°9 

I  (3)  Fall ing/Bl owing  Snow 
j  (4)  Sleet 

' _ (5)  Sand  Storm 

(6)  No  Precipitation 

D.  WIND 


(1)  High  Head  Wind 

_  (2)  High  Tail  Wind 

_  (3)  Significant  Swirling  Wind  Gusts 

~~  (4)  Cross  Wind 

_  (5)  No  Wind 

E.  HUMIDITY 


(1)  High 

(2)  Low 

(3)  Normal 


SCOPE  CATEGORY:  2.  TERRAIN 


A.  GROUND  SLOPE 


(1) 

Flat 

(2) 

Low  Positive 

Hilly 

!3) 

Low  Negative 

Hilly 

(4) 

High  Positive 

Mountainous 

(5) 

High  Negative 

Mountainous 

B. 

GROUND  SURFACE 

— I 

(1) 

Sandy 

(2) 

Rocky 

(3) 

Loam  (Deep  So 

il) 

(4) 

Paved 

(5) 

Broken  Paved 

(6) 

Broken  Ground 

(7) 

Plowed  Fields 

(8) 

Bare  Packed 

(9) 

Vegetation  Covered 

C. 

GROUND  AND  WATER  SURFACE 

— 

(1) 

Light  Mud 

(2) 

Heavy  Mud 

(3) 

Dry 

(4) 

Water  Covered 

(5) 

Ice  Covered 

Zj 

(6) 

Snow  Covered 

D. 

OBSTACLES 

(1)  Dense  Vegetation 

(2)  Light  Vegetation 

(3)  Hedge  Rows 

(4)  Rivers 

(5)  Manmade  Structures 

(6)  Traps 

(7)  No  Obstacles 
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SCOPE  CATEGORY:  4.  PERSONNEL 


A.  WORKLOAD 

(1)  When  Personnel  are  only  performing  this  issue 

(2)  When  Personnel  perform  all  activities  which  might  occur  at  the 

“  "  same  time  this  issue  is  being  performed 

B.  DURATION  OF  PRECEDING  WORK 

(1)  Following  No  Work 

_  (2)  Following  an  Extended  Period  of  Work 

_  (3)  Following  a  Normal  Period  of  Work 


PROTECTIVE  GEAR 


Blii 


While  wearing  applicable  protective  clothing/gear 
While  wearing  normal  clothing/gear 


PHYSICAL  STRENGTH 


(1)  With  Personnel  With  Minimum  Strength 

(2)  With  Personnel  With  Normal  Strength 

(3)  With  Personnel  With  Optimum  Strength 

PERCEPTUAL  ABILITY 

(1)  With  Personnel  With  Minimum  Perceptual  Ability(s) 

(2)  With  Personnel  With  Normal  Perceptual  Ability(s) 

(3)  With  Personnel  With  Optimum  Perceptual  Ability(s) 

EXPERIENCE 

(1)  With  Personnel  With  Minimum  Experience 

(2)  With  Personnel  With  Normal  Experience 

(3)  With  Personnel  With  Optimum  Experience 

APTITUDES 

(1)  With  Personnel  With  Minimun  Applicable  Aptitudes 

(2)  With  Personnel  With  Normal  Applicable  Aptitudes 

(3)  With  Personnel  With  Optimum  Applicable  Aptitudes 

PHYSICAL  SIZE 

(1)  With  Personnel  of  Minimum  Size 

(2)  With  Personnel  of  Normal  Size 

(3)  With  Personnel  of  Maximum  Size 


SCOPE  CATEGORY:  5.  TRAINING 


A.  INSTITUTION 

_ (1)  With  OJT-Trained  Personnel 

_  (2)  With  School -Trained  Personnel 

_  (3)  With  Combination  OJT  and  School 

_  (4)  With  Personnel  Without  Specific  Training 

(5)  With  Factory-Trained  Personnel 

B.  LATENCY 

_  (1)  Following  a  Period  of  Time  Without  Specific  Training  or  Practice 

_  (2)  Immediately  Following  Training 

(3)  With  the  Normal  Period  of  Latency 

C.  TEAM  VS.  INDIVIDUAL 

_  (1)  With  Personnel  Who  Have  Had  Only  Individual  Training 

_  (2)  With  Personnel  Who  Have  Had  Only  Team  Training 

(3)  With  Personnel  Who  Have  Had  a  Combination  of  Team  and  Individual 
Training 


SCOPE  CATEGORY:  6.  OPERATIONAL 


A.  CREW 

(1)  With  Operational  Crew 

(2)  With  Minimum  Crew 


B.  HARDWARE 

(1)  With  Hardware  Fully  Up 

(2)  With  Partial  Breakdown 

(3)  With  Hardware  Fully  Down 

C.  INFORMATION  INPUTS 

1)  With  Full  Information  Inputs 

2)  With  Partial  Information  Inputs 

3)  With  No  Information  Inputs 
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PROCEDURE  FOR  PERFORMANCE  TESTING 
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S3.1  Developing  Tasks  Required  for  the  Performance  of  Operability  Issues 
This  section  provides: 

(1)  A  "Task  Index"  that  relates  categories  of  operability  issues 
to  jobs  and  tasks  required  for  their  performance. 

(2)  A  list  of  jobs  and  tasks  that  apply  to  each  type  of 
operability  issue. 


h 


The  procedure  for  developing  tasks  is: 

(1)  Refer  to  the  Task  Index  on  page  S3-2  for  each  operability  issue. 

(2)  For  each  issue,  determine  which  category  (or  categories)  of 
issues  apply. 

(3)  Turn  to  the  page(es)  listing  the  jobs  and  tasks  referenced  by 
the  category  of  issues  chosen. 

(4)  Review  the  tasks  contained  in  the  list  that  is  referenced. 

(5)  Determine  which  tasks  are  absolutely  required  for  success  of 
that  issue.  In  some  cases,  the  tasks  listed  may  be  directly 
usable  in  defining  performance  measures.  In  other  cases,  the 
lists  may  be  used  as  an  aid  to  determine  the  level  and  types 
of  tasks  that  must  be  obtained. 

(6)  In  the  case  of  unscheduled  maintenance,  use  both  the  maintenance 
task  list  and  previous  OT  and  DT  results  to  predict  high 
probability  unscheduled  maintenance  tasks. 


TASK  INDEX 


OPERABILITY 

ISSUE 

CATEGORIES 

1.  WEAPON  DELIVERY  -  CONVENTIONAL 

2.  WEAPON  DELIVERY  -  GROUND  TO  GROUND  MISSILES 

3.  WEAPON  DELIVERY  -  HAND  GRENADES 

4.  WEAPON  DELIVERY  -  MINES 

5.  TARGET  ACQUISITION 

6.  MANEUVERABILITY/TRANSPORTATION  - 
GROUND  VEHICLES 

7.  MANEUVERABILITY /TRANSPORTATION 
HELICOPTERS 

8.  VULNERABILITY/SURVIVABILITY  - 
GROUND  VEHICLES 

9.  VULNERABILITY/SURVIVABILITY  - 
HELICOPTERS 

10.  COMMAND  AND  CONTROL 

11.  CONMUNICATIONS 

12.  RECONNAISSANCE 

13.  ENGINEERING 


TASK  LIST 
PAGE  NUMBER 

S3-3 

S3-5 

S3-5 

S3-7 

S3-4,8,9,10 
S3-27.31 ,32 

S3-28, 29,30, 21  ,32 

S3-27,32,34,35,36, 

37 

S3-23,29,30,32,35, 

36,37 

S3-11  through  S3-21 
S3-24,25 ,26 
S3-22.23 
S3-33,38,39 


14.  MAINTENANCE 
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JOB  #1:  WEAPON  DELIVERY 


TASKS 

1.  Assemble  system. 

2.  Emplace  system. 

3.  Calibrate  system  components  including  boresighting  and  zeroing 

4.  Acquire  target(s)  (This  task  is  dealt  with  as  a  separate  job. 
Turn  to  page  S3-4,  to  complete  it.) 

5.  Select  anmunition. 

6.  Prepare  ammunition  for  firing. 

7.  Communicate  fire  order  and  other  intracrew  instructions. 

8.  Fire  weapon. 

9.  Dispose  of  spent  casing(s). 

0.  Guide  weapon  to  target. 

1.  Perform  misfire  procedure. 

2.  Perform  hangfire  procedure. 

3.  Clear/swab/clean  appropriate  sections  of  system. 

4.  Disassemble  system. 


JOB  #2:  TARGET  ACQUISITION 


TASKS 

1.  Detect  target(s). 

2.  Identify  target(s). 

3.  Select  target(s)  and  target  order. 

4.  Orient  weapon  system  in  general  firing  position. 

5.  Determine  range  of  target. 

6.  Aim  weapon  system.  This  involves  a  procedure  which  results  in  the 
system  being  adjusted  for  the  azimuth  and  elevation  of  the  target. 

7.  Illumination  or  designate  target. 

8.  Adjust  aim,  following  miss. 

9.  Shift  to  second  target. 
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JOB  § 3:  WEAPON  OELI VERY--GROUND  TO  GROUND  MISSILES 
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TASKS 

1.  Mate  warhead  to  missile. 

2.  Load  and  secure  missile  on  launcher. 

3.  Convert  transport  to  launcher. 

4.  Position  and  emplace  launcher. 

5.  Lay  system  for  azimuth  and  elevation 

6.  Install  sighting  components. 

7.  Calibrate  system  including  boresighting  and  collimating. 

8.  Conduct  missile  system  prefire  checkouts. 

9.  Arm  system. 

10.  Inspect  system  for  defects. 

11.  Identify/determine  target. 

12.  Identify/determine  target  coordinates. 

13.  Program  missile. 

14.  Initiate  firing  sequence. 

15.  Fire  system. 

16.  Guide  missile  to  target. 

17.  Handoff  missile  to  intermediate  guidance. 

18.  Perform  missile  no-go  procedure. 

19.  Perform  misfire  procedure. 

20.  Perform  hangfire  procedure. 
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JOB  #4:  WEAPON  OELIVERY--HAND  GRENADES 


TASKS 

1.  Inspect  grenade  for  defects. 

2.  Correct  applicable  defects. 

3.  Attach  to  appropriate  part(s)  of  person/harness/etc. 

4.  Acquire  target;  include  the  judgment  of  distance  to  target. 

5.  Aim  grenade. 

6.  Launch  grenade. 

7.  Adjust  launch  based  on  location  of  detonation  in  relation  to  target. 


JOB  #5:  WEAPON  DELI VERY--MINES 


TASKS 

1.  Select  appropriate  location  for  mine  installation 

2.  Inspect  mine/triggering  device/fusing  device. 

3.  Transport  mine. 

4.  Prepare  mine  for  installation. 

5.  Install  mine  (including  the  digging  of  a  hole). 

6.  Camouflage  mine/triggering  device. 

7.  Aim  mine,  if  applicable. 

8.  Test  circuit(s). 

9.  Arm  mine. 

0.  Fire  mine,  if  applicable. 

1.  Disarm  mine. 


JOB  #6:  TARGET  INFORMATION  GATHERING  AND  INTERPRETATION 


TASKS 

1.  Assemble  system. 

2.  Position  system  in  appropriate  location. 

3.  Select  type  and  number  of  sensors. 

4.  Position  sensors  in  appropriate  location. 

5.  Calibrate/align  system  components. 

6.  Detect  target(s). 

7.  Identify  target(s). 

8.  Determine  number  of  targets. 

9.  Determine  target(s)  location/range. 

10.  Determine  target  speed. 

11.  Determine  target  direction. 

12.  Determine  target  formation/tactical  situation. 

13.  Select  and  order  targets  based  on  the  matching  of  priorities  with 
target  information  gathered. 

14.  Recognize  countermeasures  and  take  appropriate  action. 


JOB  #7:  TARGET  DESIGNATION 


:s 


Assemble/disassemble  system. 

Calibrate/align  system. 

Select  designator  system  position. 

Acquire  target  (see  Target  Acquisition,  page  S3-4) 
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JOB  #8:  TARGET  BEHAVIOR  PREDICTION 


TASKS 

1.  Predict  maneuver  of  target(s). 

2.  Predict  location  of  target(s)  after  given  time  interval,  or  predict 
time  interval  to  arrive  at  given  location  (location  includes  range 
altitude,  azimuth,  elevation,  etc.) 

3.  Predict  attack  of  target(s)  on  friendly  force. 

4.  Predict  time/location  for  successful  attack  on  target(s). 
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J08  #9:  WEAPON  FUNCTION  MANAGEMENT 


TASKS 

1.  Determine  type  of  target. 

2.  Determine  speed/direction  of  target. 

3.  Determine  target  range  at  time  of  weapon  delivery. 

4.  Determine  weather  conditions  that  impact  weapon  delivery  and 
adjust  for  them. 

5.  Determine  type  of  ammunition  to  be  used  based  on  all  above  factors. 

6.  Determine  probable  amount  of  ammunition  required  to  kill  target  under 
existing/projected  conditions. 

7.  Recommend  action  based  on  available  supply  of  ammunition,  future 
probable  requirements  for  ammunition,  and  probable  required  amount 
to  kill  target  at  various  ranges/speeds. 
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JOB  #10: 

REPRESENTATION  OF  TERRAIN/OBSTACLES/INSTALLATIONS/WEATHER 


TASKS 


1.  Indicate  key  terrain  features  which  might  affect  outcome  of  the 
operation. 

2.  Indicate  man-make  obstacles  which  might  affect  the  outcome  of  the 

operation^ . 


Indicate  installations  which  might  affect  the  outcome  of  the 

operation^ . 


4.  Indicate  features  of  weather  which  might  affect  the  outcome  of  the 
operational . 


5.  Identify  important  information  which  is  missing- 

6.  Identify  important  information  which  is  internally  inconsistent 
or  probably  inaccurate. 

7.  Develop  alternate  information  sources. 

8.  Prioritize  information  according  to  user(s)  need  and  probability 
of  its  accuracy. 

9.  Prioritize  list  of  information  users  for  receipt  of  information 
based  on  their  functions  in  this  specific  operation  and  their 
requi rements  . 


I 


Your  consideration  of  terrain  features  should  include  the  following: 


coastline  configuration 
exits  from  beaches 
avenues  of  approach 
cover  and  concealment 
observation  and  fields  of  fire 
defiladed  areas 

areas  suitable  for  aviation  landing 


soil  composition 
water  depth 
terrain  slopes 
beach  characteristics 
elevations 

accessibility  of  terrain  features 


Your  consideration  of  man-made  obstacles  should  include  the  following: 


mi  nefields 
tank  traps 
water  obstacles 
ditches 

destroyed/potenti ally  destroyed  bridges,  tunnels,  etc. 
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JOB  #10:  REPRESENTATION  OF  TERRAIN/OBSTACLES/ 
INSTALLATIONS/WEATHER  (CONT'd) 


Your  consideration  of  installations  should  include  the  following 

airports  enemy  air  defense 

heliports  enemy  radar  facilities 

enemy  depots  enemy  satellite  microwave 

enemy  command  posts  receiving  stations 

enemy  transportation  facilities 
enemy  communication  facilities 
enemy  power  operation  faci li ti es/1 i nes 
enemy  positions 

Sfour  consideration  of  weather  should  include  the  following: 

visibility  data 
wind  data 
temperature  data 


humi di ty  data 
precipitation  data 


JOB  #11:  REPRESENTATION  OF  STATUS  OF  FORCES 


TASKS 

1.  Indicate  location(s)  of  forces. 

2.  Indicate  composition  (nunber  and  type)  of  forces. 

3.  Indicate  availability  of  forces. 

4.  Indicate  peculiarities/weaknesses  of  forces. 

5.  Indicate  recent  significant  tactical  events  in  which  specific  units 
were  involved. 

6.  Indicate  actions  which  forces  are  currently  pursuing*. 

7.  Indicate  the  enemy  commander(s ) '  previous  behavior  in  similar 
si tuations. 

8.  Indicate  combat  effectiveness  of  forces. 

9.  Indicate  relative  combat  power  of  enemy  to  friendly  units. 

10.  Indicate  relevant  threat  potentials  of  enemy  forces. 

11.  Identify  important  missing  information. 

12.  Identify  important  information  which  is  internally  inconsistent 
or  probably  inaccurate. 

13.  Develop  alternate  sources  of  information. 

14.  Prioritize  information  according  to  the  user(s)  needs  and  probability 
of  its  accuracy. 

15.  Prioritize  list  of  information  user(s)  for  receipt  of  information 
based  on  their  functions  in  this  specific  operation  and  their 
requirements  . 


1 


Your  consideration  of  these  actions  should  include: 


direction  of  movement 

speed  of  movement 

apparent  purpose(s)  of  movement 


JOB  #12:  PROJECTION  OF  BATTLEFIELD  OPERATIONS 


TASKS 

1.  Determine  observable  indicators  of  possible  changes  in  the 
operational  situation. 

2.  Prioritize  indicators  of  operational  changes. 

3.  Assign  intelligence  collection  tasks  to  maximize  receipt  of 
indicators  according  to  their  priorities. 

4.  Monitor  intelligence  collection  and  reassign  tasks  based  on 
updated  information. 

5.  Display  pertinent  information. 

6.  Identify  important  missing  information. 

7.  Identify  important  information  which  is  internally  inconsistent  or 
probably  inaccurate. 

8.  Develop  alternate  sources  of  information. 

9.  Determine  which  model (s)  of  expected  enemy  behavior  best  fits 
collected  information. 

0.  Assign  confidence  levels  to  the  projection(s ) . 

1.  Make  recommendations  about  the  effects  of  projected  operations. 

2.  Prioritize  information  according  to  user(s)  needs  and  probability 
of  accuracy. 

3.  Prioritize  list  of  information  users  for  receipt  of  information 
based  on  their  functions  in  this  specific  operation  and  their 
requi rements . 


JOB  #13:  PROJECTION  OF  WEATHER  CONDITIONS 


TASKS 

1.  Collect  relevant  weather  information  for  the  applicable  area(s). 

2.  Develop  alternative  weather  projections  and  their  indicators. 

3.  Assign  probabilities  to  weather  projections. 

4.  Determine  effects  of  alternate  weather  projections  on  operation(s) 

5.  Prioritize  indicators  of  weather  projections. 

6.  Assign  weather  indicator  tasks- 

7.  Monitor  weather  indicator  collection  and  reassign  tasks  based  on 
updated  information. 

8.  Update  projection  probabilities. 

9.  Collect,  order  and  display  pertinent  information. 

10.  Identify  important  missing  information. 

11.  Identi fy.  important  information  which  is  internally  inconsistent 
or  probably  inaccurate. 

12.  Develop  alternate  sources  of  information. 

13.  Prioritize  information  according  to  user(s)  needs  and  probability 
of  accuracy. 

14.  Prioritize  list  of  information  users  for  receipt  of  information 
based  on  their  functions  in  this  specific  operation  and  their 
requirements . 


JOB  #14:  SELECT  THE  MOST  APPROPRIATE 
FRIENDLY  UNIT(S)  TO  ENGAGE  IN  OPERATION 


TASKS 

1.  Determine  the  requirements  the  operation  will  make  on  the  friendly 
unit. 

2.  Order  these  requirements  based  on  commander's  priorities. 

3.  Identify  friendly  unit(s)  with  the  appropriate  mix  of  attributes 
to  match  the  prioritized  requirements. 

4.  Determine  which  friendly  units,  with  the  correct  attributes,  can  be 
removed  from  their  present  operations  without  unacceptable  conse¬ 
quences. 

5.  Determine  the  transportation  systems  required  to  move  each  friendly 
unit  to  the  operational  area. 

6.  Determine  the  availability  of  each  transportation  system  required 
to  move  each  friendly  unit  and  the  time  required  for  it  to  perform 
its  function. 

7.  Determine  the  logistics  required  by  each  friendly  unit  to  perform 
its  functions  in  the  operation  in  question. 

8.  Determine  the  availability  of  the  supplies  and  delivery  systems  to 
the  operations  area  for  the  required  logistics  of  each  friendly  unit. 

9.  Display  all  significant  information  and  order  it  in  some  logical  and 
helpful  manner. 


S3-17 


JOB  #15:  SELECTION  AND  ORDERING 
OF  APPROPRIATE  TARGETS 


TASKS 

1.  Locate  potential  targets. 

2.  Identify  type  and  ntmber  of  potential  targets. 

3.  Determine  threat  potentials  of  targets. 

4.  Determine  availability  of  appropriate  friendly  weapon  system 

5.  Determine  the  probability  of  eliminating  target(s). 

6.  Prioritize  targets. 

7.  Select  targets  to  attack  . 


JOB  #16:  CONTROL  OF  FRIENDLY  FORCES 
ON  THE  BATTLEFIELD 


TASKS 

1.  Determine  commander's  desired  outcome  and  priorities. 

2.  Determine  the  tactics  to  be  followed. 

3.  Select  the  most  appropriate  friendly  unit(s)  to  engage  in  operation*. 
(See  Select  the  Most  Appropriate  Friendly  Unit(s)  to  Engage  in 
Operation,  page  S3-17.) 

4.  Determine  travel  routes  for  friendly  units. 

5.  Determine  departure  and  projected  arrival  times  for  friendly  units. 

6.  Prepare  contingency  plans  and  the  situations  in  which  each  is  to 

be  implemented. (See  Projection  of  Battlefield  Operations,  page  S3-15.) 

7.  Prepare  plans,  orders,  maps,  and  other  required  documents. 

8.  Prepare  materials  for  briefing  commanders  and  staffs. 

9.  Monitor  units'  compliance  with  orders  and  their  progress. 

10.  Identify  critical  situations  which  indicate  significant  changes  in 
battlefield  operations. 

11.  Update  plans/orders  as  battlefield  situation  changes. 


*The  following  types  of  units  should  be  considered  in  this  selection 
process : 

(1)  first  echelon 

(2)  reserve 

(3)  intelligence 

(4)  counter-intelligence 

(5)  maintenance 

(6)  logistics 


S3-19 


JOB  #17:  LOGISTICS 


TASKS 

1.  Maintain  information  on  current  status  of  supplies. 

2.  Maintain  information  on  maintenance  status  of  equipment  needed 
for  mission. 

3.  Recommend  location  of  rear  boundary  bases. 

4.  Recommend  main  and  secondary  supply  routes. 

5.  Determine  throughput  unit  supply  requirements. 

6.  Recommend  movements  which  are  consistent  with  logistics  considerations. 

7.  Develop  policies  for  area  damage  control  operations. 


JOB  #18:  PERSONNEL  PLANNING 


TASKS 

1.  Prepare  personnel  estimate  based  on  requirements  of  operation. 

2.  Estimate  casualty  rates  cf  friendly  forces  and  projected  POW's. 

3.  Prepare  evacuation  contingency  plans. 

4.  Coordinate  personnel  replacement  plans  with  appropriate  organizations. 


JOB  #19:  RECONNAISSANCE/FIRE  CONTROL 


IS 

Determine  target  type/nunber/si ze/di rection/speed/elevation. 
Determine  weather  conditions  affecting  weapons  delivery. 
Determine  target  coordinates. 

Mark  target  locations;  this  may  be  done  by  physical,  chemical, 
radiological  or  electronic  means. 

Handoff  target(s)  to  attack  units- 

Determine  effects  of  fire  on  target. 

Relocate  target (s ) . 

Adjust  fire  of  attacking  unit(s). 


JOB  #20:  BATTLEFIELD  RECONNAISSANCE 


TASKS 

1.  Identify  key  environmental  features. 

2.  Identify  current  weather  conditions. 

3.  Identify  key  elements  of  threat  force  . 

4.  Identify  essential  information  for  evaluating  NBC  contamination 
hazard  outer  limits. 

5.  Identify/select  routes. 

6.  Present  information  about  routes  which  could  influence  movement. 

7.  Identify  hazards  to  movement. 

8.  Identify  early  warning  of  enemy  threat. 

9.  Report  map  changes. 
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JOB  421:  ESTABLISHMENT  AND  MAINTENANCE 
OF  COMMUNICATIONS 


TASKS 

1.  Assemble  communications  device(s). 

2.  Assemble/erect/orient  antenna. 

3.  Establish  communications  net. 

4.  Enter  communications  net. 

5.  Transmit  messages . 

6.  Receive  messages. 
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JOB  422:  PREVENTION  Of  INTERCEPTION/JAMMING 


TASKS 

1 .  Encode  messages  . 

2.  Authenticate  transmissions. 

3.  Decode  messages  . 

4.  Apply  anti-jansning  procedures. 

5.  Apply  transmission  security  procedures. 
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JOB  #23:  INFORMATION  ROUTING 


S 

Identify  appropriate  recipients  of  information. 

Prioritize  recipients  for  the  delivery  of  information. 

Prioritize  pieces  of  information  for  delivery. 

Assign  security  classification  and  method  for  maintaining  that 
classification. 

Determine  call  signals/frequencies. 


JOB  *24: 


VEHICLE  MANEUVERING- -GROUND  VEHICLES 


TASKS 

1.  Observe  environment  for  obstacles,  landmarks,  etc. 

2.  Read  and  use  instruments  appropriate  to  vehicle  maneuvering 

3.  Perform  the  following,  moving  backward  (B)  and/or  forward  (F) 
Circle  B  or  F  as  appropriate. 


3.1 

Tight  turn(s)  B  F 

3.2 

Wide  turn(s)  B  F 

3.3 

Accelerating  turn(s) 

B  F 

3.4 

Decelerating  turn(s) 

B  F 

3.5 

Rapid  acceleration  B 

F 

3.6 

Gradual  acceleration 

B  F 

3.7 

Rapid  deceleration  (no 

stop) 

3.8 

Gradual  deceleration 

B  F 

3.9 

Sudden  stop  B  F 

3.10  Maintain  constant  speed  B  F 
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JOB  ?25:  VEHICLE  MANEUVER  I NG- -HEL ICOPTER 


S 

Perform  takeoff  to  hover. 

Perform  instrunent  takeoff. 

Perform  hover  checks . 

Perform  hovering  turns- 

Perform  hovering  flight- 

Perform  normal  takeoff - 

Perform  maximun  performance  takeoff. 

Perform  straight  and  level  flight- 
Perform  climbs  and  descrnts • 

Perform  turns  . 

Perform  instrument  turns. 

Perform  accele-'ati  on/deceleration . 

Perform  traffic  pattern  flight. 

Perform  high  speed  flight. 

Perform  hovering  autorotation. 

Perform  standard  autorotation. 

Perform  standard  autorotation  with  turn. 
Perform  holding  procedures  . 

Perform  unusual  attitude  recovery. 

Perform  be  fore- 1 andi ng  check. 

Perform  shallow  approach  to  a  running  landing. 
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JOB  ft 25:  VEHICLE  MANEUVERING* -HELICOPTERS  (CONT’D) 

TASKS 

22.  Perform  landing  from  h over. 

23.  Perform  normal  landing  approach. 

24.  Perform  shallow  landing  approach. 

25.  Perform  steep  landing  approach. 

26.  Perform  instrument  approach. 

27.  Perform  GCA  approach. 

28.  Perform  IFR  helicopter  recovery  procedure. 

29.  Perform  tactical  instrument  approach. 

30.  Perform  go  around- 
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JOB  #26:  TACTICAL  VEHICLE  MANEUVERI NG--HEL ICOPTERS 


5 

Perform  terrain  flight  takeoff. 

Perform  hover  out  of  ground  effect. 

Perform  terrain  flight  navigation. 

Perform  contour  flight. 

Perform  NOE  flight  including  masking  and  unmasking. 
Perform  confined  area  operations. 

Perform  slope  operations. 

Perform  pinnacle/ridgeline  operation. 

Perform  evasive  maneuvers. 

Perform  low-level  flight. 

Perform  circling  approach. 

Operate  radar  warning  receiver. 

Perform  visual  glide  slope  approach  and  landing. 
Perform  ski  1  and i  ng  . 

Perform  amphibious  operations. 


JOB  #2  7:  NAVIGATION 


3 

Select  appropriate  maps  and/or  navigation  aids. 

Identify  present  location. 

Identify  destination. 

Select  travel  route. 

Estimate  time  of  arrival  and  fuel  requirements. 

Travel  designated  route. 

Identify  position  or  route  at  specified  times/locations 


JOB  4 28:  VEHICLE  LOADING/UNLOADING 


5 

Load  and  position  cargo/passengers  in/on  vehicle. 
Secure  cargo/passengers  . 

Unload  vehicle. 

Fuel  vehicle 


Load  ammunition  . 


JOB  *29:  VEHICLE  RECOVERY 


TASKS 

1.  Position  recovery  vehicle(s). 

2.  Prepare  recovery  vehicle(s). 

3.  Prepare  system  to  be  recovered. 

4.  Attach  cables  between  system  to  be  recovered  and  recovery  vehicles 

5.  Reconnoiter  recovery  area. 

6.  Tow/lift/push  system  to  be  recovered. 

7.  Disassemble/stow  recovery  equipment. 


JOB  *30:  SELF-RECOVERY 


TASKS 

1.  Prepare  system  for  sel f-recovery  . 

2.  Reconnoiter  for  appropriate  anchor  points  and  recovery  path  . 

3.  Position  anchors  . 

4.  Attach  cables  to  anchors /wi nches . 

5.  Pull  system  to  safe  area. 

6.  Disassemble/stow  sel f-recovery  components. 


JOB  #31 :  ESCAPE  FROM  SYSTEM  HARDWARE 


TASKS 

1.  Destroy  or  alter  critical  components  of  communication  and  other 
sensitive  equi pment/documents . 

2.  Take  personal  weapon,  ammunition,  and  survival  equipment. 

3.  Position  system  hardware  for  escape,  if  possible  under  the  conditions 
imposed . 

4.  Open  escape  path  out  of  system  hardware. 

5.  Escape  from  system  hardware. 


JOB  #32:  SYSTEM  PROTECTION  FROM  THREAT 


TASKS 

1.  Identify  threat  to  system,  e.g.,  onboard  fire,  flooding,  imminent 
crash,  NBC,  enemy  attack. 

2.  Activate  hardware  protective  device(s). 

3.  Put  on  protective  gear/clothing. 

4.  Secure  materi al/cargo  for  protection  against  threat. 

5.  Assume  protective  position  for  crew/passengers. 

6.  Maneuver  to  protect  from  threat. 

7.  Deactivate  hardware  protective  device(s). 
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JOR  433 :  PREVENTION  OF  DETECTION/ 
LOCATION  OF  SYSTEM 


TASKS 

1.  Detect  threat  warning(s)  which  indicate  either  search  or  attack 
modes . 

2.  Identify  the  nature  of  the  threat(s)  from  which  detected  threat 
warnings  emanate- 

3.  Take  appropriate  countermeasures  to  reduce  the  probability  of 
identification  of  location*  - 

2 

4.  Camouflage  system  . 


^These  countermeasures  include: 

jammi ng 
smoke 
flares 
chaff 

powered  decoys 
signature  alteration 

electronic  attact  of  threat-sensing  equipment 

2 

System  camouflage  includes: 

physi cal 
infrared 

radar  signature  reduction 


JOB  ^ 34 :  ENGINEERING- -OBSTACLE 
REMOVAL/BREACHMENT 


TASKS 

1.  Acquire  obstacle  to  be  dealt  with  . 

2.  Prepare  system  hardware  for  obstacle  removal /breaching.  The  nature 

of  this  preparation  is  entirely  dependent  upon  the  sort  of  system 
under  consideration.  It  may  involve  preparation  for  bulldozing, 
gun  firing,  demolition,  etc. 

3.  Decide  on  placement  of  fire,  charge,  or  pressure  in  relation  to 
obstacle.  (See  S3-3  and  S3-4.) 

4.  Remove/breach  obstacle. 

5.  Remove/displace  remains  of  obstacle. 
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JOB  #35:  ENGINEERING-BRIDGING 


5 

Prepare  bridge  site. 

Excavate  foundations. 

Construct  bridge  abutments. 

Construct  bridge  span. 

Construct/assemble  bridge. 

Prepare  bridge  for  launching. 

Position  bridge  transporter  for  launching. 
Launch/drive  bridge  into  water. 

Connect  bridge. 

Recover  bridge. 

Disassemble  bridge. 


JOB  336:  MAINTAIN  SYSTEM  (Scheduled  or  Unscheduled) 

TASKS 

1.  Inspect 

2.  Lubricate 

3.  Purge 

4.  Drain 

5.  Fill 

6.  Clean 

7.  Troubleshoot/Diagnose 

*  8.  Remove 

9.  Disassemble 
10.  Assemble 

*  11.  Install 

12.  Adjust/Align 

13.  Test 

*  If  remove  and  install  are  impractical ly  small  tasks  for  field  test 
measurement,  they  may  be  replaced  by--Change/Repl ace . 
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S3."  Deter  :n  i  n  1  ng  the  Number  jt  Trials  and  P 1  ayers 

It  is  important  to  note  that  the  procedure  for  determining  the  number  of 
trials  and  players  is  described  below  in  issue  terms.  Issue  performance 
is  a  composite  of  the  performance  of  all  tasks  that  comprise  that  issue. 
Therefore,  the  number  of  trials  and  players  used  to  test  each  issue  will  be 
the  same  as  the  number  of  players  and  trials  used  to  test  the  component 
tasks . 

In  planning  an  Operational  Test,  a  stage  is  reached  when  a  decision  must 
be  made  about  the  number  of  trials  to  be  performed  for  each  of  the 
operational  issues.  If  the  number  of  trials  is  too  large,  resources  are 
being  wasted;  if  it  is  too  small,  the  reliability  of  the  test  results  is 
significantly  reduced.  In  this  context,  rel iabi 1 i ty  is  the  extent  to 
which  test  results  would  be  repeatable  by  other  subject  groups  taken  from 
the  real  population  of  users. 

In  essence,  there  are  two  related  decisions  that  must  be  made  with  regard 
to  th?  field  test.  The  first  is  the  number  of  trials  each  performance  unit 
will  perform  in  the  test.  The  second  decision  is  the  number  of  performance 
units  which  will  take  part  in  the  test. 

A  performance  unit  consists  of  the  players  needed  for  a  single  system  to 
measure  the  issue.  For  example,  the  performance  unit  for  firing  a  rifle 
consists  of  one  person,  whereas  the  performance  unit  for  detecting  targets 
in  a  medium  tank  may  consist  of  two  people  (the  commander  and  the  gunner). 

It  is  suggested  that  you  try  to  get  statistical  assistance  from  experts 
regarding  the  number  of  trials  pe1"  performance  unit  (i.o.,  a  group  of 
players)  and  the  number  of  units  needed  to  perform  each  issue  under  ease. 


set  of  conditions.*  If  statistical  guidance  is  not  available,  use  the 
following  general  guidelines  to  determine  the  number  of  trials  per 
performance  unit,  and  the  number  of  performance  units  needed. 

To  calculate  the  number  of  trials  and/or  the  number  of  performance  units 
for  the  Operational  Test,  one  has  to  determine  two  parameters: 

(1)  The  maximum  error  permitted  for  an  issue. 

(2)  The  acceptable  level  of  confidence. 

Chances  are  that  no  sample  taken  will  be  an  exact  representation  of  the 
real  population  that  will  use  the  system  in  question.  For  this  reason, 
the  statistics  taken  on  the  sample  population  will  probably  provide  somewhat 
different  results  than  you  would  obtain  by  using  that  entire  population. 

The  difference  between  the  results  from  the  sample  population  and  those  from 
the  entire  population  is  the  error.  In  general,  as  the  size  of  your  sample 
increases,  and  therefore  becomes  more  like  the  real  population,  the  error 
will  decrease;  however,  your  testing  expenses  will  increase.  For  this 
reason,  you  have  to  decide  on  the  maximum  acceptable  size  of  this  error; 
that  is,  the  difference  between  sample  and  entire  population  results  that  is 
acceptable.  Suppose  you  have  decided  that  you  can  permit  a  maximum  error  of 
five  percent  between  sample  population  testing  results  and  real  population 
results;  you  then  have  to  decide  how  much  confidence  you  must  have  that  your 
results  will  not  exceed  this  error.  This  is  the  level  of  confidence  you 
require.  It  is  expressed  as  a  percentage.  For  example,  you  may  decide  that 
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Box,  G.,  Hunter,  W.,  Hunter,  J.  Statistics  for  Experimenters  New  York, 
John  Wiley  and  Sons,  1978. 

Cohen,  J.  Statistical  Power  Analysis  for  the  Behavioral  Sciences,  New  York, 
Academic  Press ,  1 969 . 

Kirk,  R.  Experimental  Design:  Procedures  for  the  Behavioral  Sciences, 
Belmont,  CA,  Brooks/Cole,  1968. 


y  lu  £>*.*  i'.i *  confident  that  your  results  will  not  exceed  a  five  percent 

error,  [he  hiijher  the  minimal  acceptable  level  of  confidence,  while  holding 
the  error  constant,  the  larger  the  sample  population  will  have  to  be. 
Consequently,  you  will  need  a  larger  number  of  trials  per  player  (or 
performance  unit)  and  a  larger  number  of  players  (or  performance  units)  in 
the  Operational  Test. 

The  following  procedure  applies  to  the  measure  of  each  issue  under  a  specific 
set  of  conditions.  Therefore,  if  a  measure  is  to  be  calculated  for  each 
condition  set  of  an  issue  separately,  the  number  of  trials  and  performance 
units  applies  to  each  condition  set  separately.  If,  on  the  other  hand,  you 
will  aggregate  your  measures  across  condition  sets,  then  the  number  of  trials 

and  performance  units  applies  to  all  the  condition  sets  together.  In  this 

case,  it  will  be  necessary  to  divide  the  number  of  trials  equally  between 

the  aggregated  sets  of  conditions. 

(1)  Decide  on  the  number  of  trials  per  performance  unit  for  each 
issue  under  each  condition  set. 

It  has  been  determined,  based  on  experimental  statistical 
research,  that  at  least  five  trials  for  each  performance  unit 
should  be  used  in  an  Operational  Test**  This  will  supply  the 

mi nimum  amount  of  data  necessary  to  meet  the  statistical 

assumptions  underlying  the  determination  of  sample  sizes.  If 
less  than  five  trials  are  used,  the  determination  of  sample 
size  becomes  more  tenuous. 


,  Crolotte,  A.  Cours  de  Statistique,  Faculte  des  Sciences  Economiques 
lO  ene  anee)  Universite  Rationale  Gabonaise,  Libreville,  1974. 
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We  will  supply  you  with  tables  based  on  the  assumption  that 
you  will  use  five  trials  per  unit.  However,  we  will  also 
supply  you  with  a  formula  to  use  if  you  decide  on  more  or 
fewer  than  five  trials  per  unit. 

Note:  It  is  not  recommended  that  you  use  more  than  ten 
trials  per  unit. 

(2)  Decide  on  the  number  of  performance  units  to  be  used  to  test 
each  issue  under  each  condition  set.  This  decision  depends  on 
whether  the  statistic  used  for  this  issue  is  a  percentage  or  an 
average.  We  will  discuss  each  in  turn. 

Percentage  Statistics 


(a)  Decide  which  confidence  level  is  acceptable.  Conventionally, 
95%  is  selected  as  the  appropriate  confidence  level  for 
rigorous  experimentation,  but  in  the  case  of  Operational 
Testing,  a  lower  confidence  level  may  be  acceptable.  The 
lower  the  confidence  level  selected,  the  fewer  performance 
units  you  will  require. 

Table  S3-1  includes  the  95%,  90%,  85%,  and  80%  confidence 
levels.  No  matter  which  confidence  level  you  select,  it 
must  be  the  same  for  all  statistics  of  a  given  issue.  You 
may  use  the  same  confidence  level  for  all  issues.  However, 
if  some  issues  require  a  higher  confidence  level  than  others, 
you  may  wish  to  define  a  higher  confidence  level  for  those 
issues.  This  will  affect  the  size  of  the  player  populations 


(b)  Determine  the  maximum  error,  in  terms  if  percentage  points, 
that  is  acceptable.  For  example,  it  you  accept  an  error  of 
five  percentage  points,  then,  with  your  level  of  confidence, 
you  could  say  that  the  real  population  value  is  within  ±five 
percentage  points  of  the  result  obtained  during  the 
Operational  Test  which  used  only  a  sample  from  that  popula¬ 
tion.  Of  course,  the  larger  the  error  you  accept,  the  less 
meaningful  your  data  will  become.  However,  as  the  error 
permitted  increases,  the  number  of  performance  units 
required  decreases. 

(c)  Table  S3-1  indicates  the  number  of  performance  units 
required,  given  various  error  and  confidence  levels.  The 
table  was  constructed  assuming  five  trials  per  performance 
unit,  and  the  largest  reasonable  variance  for  the  statistic. 
If  fewer  than  five  trials  per  unit  are  to  be  used,  go  to 
the  next  instruction  to  determine  the  number  of  units 
required. 


Table  S3-1 

NUMBER  OF  PERFORMANCE  UNITS  REQUIRED 


ERROR 


952 


CONFIDENCE  LEVEL 
902  852  802 


If  five  trials  per  performance  unit  are  not  used,  the 
number  of  performance  units  required  can  be  computed 
using  the  following  formula. 


Note:  The  use  of  more  than  ten  trials  per  unit  is 
not  recommended. 

N  =  k 

2 

(error  )  X  n 
where: 

N  =  Number  of  performance  units  required. 

Error  =  Maximum  error  acceptable  (in  percentage  points), 
n  =  Number  of  trials  per  performance  unit, 
k  =  Is  a  constant  which  depends  on  the  confidence 
limit,  as  follows: 

CONFIDENCE  LEVEL  k 


95% 

9604 

90% 

5806 

85% 

5134 

** 

o 

00 

4096 

Example:  If  there  are  ten  trials  per  unit  and  you  wish 
to  be  90%  confident  that  test  results  will  be  within 
±  5  percentage  points  of  the  real  population  mean: 

N  =  6806  =  27.2  therefore  28  performance  units 

(5)2  X  10 
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(e)  Determine  which  confidence  level  is  acceptable.  See 
instruction  (a)  above  for  explanation. 

(f)  Determine  the  maximum  error  that  is  acceptable.  For 
example,  if  you  were  measuring  time  to  unload  a  truck, 
the  maximum  acceptable  error  might  be  20  minutes.  Be 
sure  to  express  the  error  in  the  same  units  as  the 
average  (i.e.,  minutes,  hours,  etc.).  With  your  level 
of  confidence,  you  could  then  say  that  the  real 
population  average  loading  time  would  be  within  ±  20 
minutes  of  the  average  obtained  during  the  Operational 
Test. 

(g)  Estimate  the  maximum  variance  expected  for  a  unit  across 
its  trials.  A  unit’s  performance  will  vary  from  trial 
to  trial.  The  variance  we  are  interested  in  is  the 
variability  of  the  most  variable  or  erratic  unit  you 
foresee  using  in  the  Operational  Test.  Thus,  variance 
can  be  estimated  using  one  of  the  following  three  methods. 
These  are  listed  in  order  of  preference: 


METHOD  I.  Pilot  Study. 


Perform  a  pilot  study  with  a  representative  unit  and 
calculate  the  variance  across  trials  using  the  following 
formula.  A  minimum  of  five  trials  should  be  used. 


n  =  the  number  of  trials  performed  by  the  unit. 

=  the  outcome  of  performance  for  trial  i. 

METHOD  2.  Previous  Data. 

Estimate  the  variance  of  a  unit  across  trials  by 
examining  data  collected  from  a  similar  system,  or 
an  earlier  OT  of  the  same  system. 

METHOD  3.  Expected  Range. 

Estimate  the  variance  of  a  unit  across  trials  by 
estimating  the  range  of  performance  across  trials  and 
using  the  following  formula.  (Note :  This  formula 
assumes  that  performance  of  a  unit  is  normally 
distributed  across  trials.) 

2 

Variance  =  (Range) 

16 

where : 

Range  =  highest  expected  value  -  lowest  expected  value 

(h)  Calculate  the  number  of  performance  units  required 
using  the  following  formula: 

N  =  kV 

2 

n(error) 


N  =  Number  of  performance  units  required. 

V  =  Maximum  variance  of  a  unit  across  trials, 

error  =  Maximum  acceptable  error. 

n  =  Number  of  trials  per  unit  (minimum  5  recommended) 

k  =  Constant  whose  value  depends  on  confidence  level 

selected: 


CONFIDENCE  LEVEL 

k 

95% 

3.84 

90% 

2.72 

85% 

2.07 

80% 

1.64 

Example:  For  time  to  load  truck,  using  five  trials  per 
unit,  and  an  estimated  maximum  variance  of  100  minutes. 
If  you  wish  to  be  90%  confident  that  the  test  mean  will 
be  within  ±  three  minutes  of  the  real  population  mean, 
then: 


(2.72)  (100) 


=  6  performance  units 


N 
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WORKSHEET  FOR  PLANNING  DATA  COLLECTION 


(1)  Are  measures  best  taken  by  an: 

Obsan/er  Instrumentation  Combination  of  Both' 

□  □  □  ■ 

If  you  selected  Observer,  or  Combination  of  Both,  continue 
with  2. 

(2)  Is  there  space  for  an  observer  without  significantly  disturbing 
the  performance  you  want  to  measure? 


YES 

NO 

□ 

□ 

If  the  answer  to  this  question  is  no,  you  will  probably  have  to 
collect  your  data  with  instrumentation;  turn  to  Step  13. 

(3)  What  sort  of  background  (previous  training,  experience,  MOS, 
etc.)  will  be  required  of  the  observer(s)? 


(6)  How  long  in  advance  of  the  OT  must  you  begin  to  arrange  for 
the  avai lability  of  these  observers? 


(5)  Who  will  provide  this  training?  The  answer  to  this  question 
may  be  obvious  if  there  are  07  personnel  who  have  been  dedi¬ 
cated  to  obsan/ation  training.  If  the  answer  is  not  obvious, 
you  should  consider  repeating  Steps  2-8  substituting  the  words 
"observer  trainer"  for  the  word  "observer." 


T 


(10)  What  sort  of  materials,  equipment,  and  information  will  be 
required  for  the  observer  training? 


(11)  Who  will  supply  observer  training  material? 


(12)  How  much  lead  time  is  required  for  the  development  of  observer 
training  material? 


\ 


M  j 

s 


\ 


>r  i 

K 


K 


Oata  development  musr  begin  - 


Date  all  material  must  be  completed  - 


(13)  Where  will  observer  training  take  place? 


(14)  How  long  will  observer  training  take? 


(15)  What  kind  of  Data  Collection  Forms  (Checklists,  etc.)  will  be 
regu i red? 


(16)  Who  will  produce  these  forms? 
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7)  3y  what  date  must  these  forms  be  completed? 


If  you  selected  Instrumentation  or  Combination  of  Both  continue 
with  Step  18. 

(18)  What  kind(s)  of  instrumentation  is  required  to  obtain  the 
necessary  data? 


Is  there  space  for  the  instrumentation  without  significantly 
disturbing  the  performance  criteria  you  want  to  measure? 


If  the  answer  to  this  question  is  no,  and  there  is  also 
inadequate  space  for  an  observer,  you  will  have  to  either: 

(1)  Switch  to  another  variety  of  i nsrrumentaT i on , 
or 

(2)  Collect  this  information  through  debriefing. 


(20)  Is  mere  adequate  power  for  ~re  device? 


YES 

NO 

□ 

□ 

If  the  answer  to  this  question  is  no,  you  will  have  to  either 

(1)  Switch  to  another  variety  of  instrumentation, 
or 

(2)  Provide  another  source  of  power, 
or 

(3)  Use  an  obsen/er  to  collect  data, 
or 

(4)  Collect  this  information  through  debriefing. 

(21)  Is  the  instrumentation  available  to  you?  To  answer  this 

question  adequately,  you  will  first  have  to  find  out: 

( 1 )  If  i t  a  I  ready  ax i sts 


YES 

NO 

□ 

□ 

(2)  Where  it  can  be  obtained 


(3)  The  lead 


Obtaining  i' 


(4)  How  long  It  takes  to  Install  it  in  your  System 


If  the  answer  is  no,  you  will  have  to 


(1)  Switch  to  another  variety  of  instrumentation, 
or 

(2)  Use  an  observer  to  collect  data, 
or 

(3)  Collect  this  information  through  debriefing. 

(22)  Are  installation  and  maintenance  of  the  instrumentation  going 
to  require  technicians  dedicated  to  this  project? 


YES 

NO 

□ 

□ 

The  answer  to  this  question  may  be  obvious  if  there  are  OT 
personnel  who  have  already  been  dedicated  to  this  function. 
If  the  answer  is  not  obvious,  you  should  consider  repeating 
the  most  applicable  of  Steps  2-3  substituting  the  word 
technician  for  observer. 


*  3crn,  »i:  quesrions  from  2-22 


If  you  selecTeo  Como  i.naT  ion  a 
apply  to  you.  In  addition  answer: 

Is  There  enough  space,  for  doth  the  observer  and  the  instru¬ 
mentation,  without  significantly  disturbing  the  performance 
criteria  you  want  to  measure? 


YES 

NO 

□ 

□ 

If  the  answer  to  this  question  is  no,  you  will  have  to: 

Cl)  Switch  to  another  form  of  instrumentation, 
or 

(2)  Remove  either  the  obsen/er  or  the  instrumentation, 
or 

(3)  Collect  this  information  through  debriefing. 


COLLECTING  ADDITIONAL  DATA  DURING  OT 


S4.1  OBSERVER  AND  PLAYER  CHECKLIST 

This  section  contains  an  observer  and  player  checklist  to  be  used  to  collect 
detailed  data  describing  the  reasons  for  task  difficulty.  This  checklist 
may  be  used  as  written,  or  individual  items  may  be  used  in  specifically 
tailored  checklists. 
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OBSERVER  AND  PLAYER  CHECKLIST 


ISSUE 

TASK: 


MANIPULATION  DIFFICULTY 

Check  any  problems  encountered  when  trying  to  manipulate  the  control (s), 
or  any  other  piece  of  equipment,  during  the  performance  of  this  task: 


_ Too  hard  to  move,  too  much  effort  required. 

_ Movement  required  unreasonable  amount  of  dexterity. 

_ Too  many  other  things  required  at  same  time. 

_ Too  easy  to  make  a  mistake. 

_ Movement  different  from  what  is  reasonable  to  .-^pect. 

- Movement  requires  unavailable  tool(s). 

- Other,  specify: _ 

REACH/ACCESSIBILITY 

Check  any  problems  encountered  when  trying  to  reach  the  control (s)  or  any 
other  piece  of  equipment  that  had  to  be  manipula+ed  during  this  task: 

-  Too  far  away  to  reach  comfortably. 

- Angle  to  it  was  such  that  it  could  not  be  reached  comfortably. 

_  It  was  fully  or  partially  blocked  by  another  object. 

_  It  was  fully  or  partially  blocked  by  another  person. 

- Reaching  it  forced  exposure  to  hazardous  or  highly  uncomfortable 

objects  (excessively  hot,  excessively  cold,  sharp,  etc.). 

—  Other,  specify: _ 


CONTROL  CONFIGURATION 

Check  any  problems  encountered  with  the  configuration  of  the  control (s), 
or  any  other  piece  of  equipment  that  had  to  be  manipulated,  during  this 
task: 

_ Too  hard  to  find. 

_ Too  hard  to  determine  what  it  was. 

_  Too  close  to  other  control /equipment. 

_ Too  far  from  other  control /equipment  used  in  same  performance 

_  Used  without  looking  at  it  much,  and  it  felt  too  much  like 

others. 

_ Too  hard  to  tell  when  it  was  activated  or  moved  to  correct 

position. 

_ Other,  specify: _ 

WORKSTATION  DESIGN  FOR  VISION 

Check  any  visibility  problems  encountered  during  this  task  caused  by  the 
workstation: 


_ Not  enough  light  on  outside  of  work  station. 

_ Window/port  not  big  enough. 

_ Window/port  not  in  right  place. 

_ Window/port  too  dirty  or  distorted. 

_ Equipment/people  in  the  way  of  window/port. 

_ Not  enough  light  inside  work  station. 

_  Too  much  glare. 

_  Important  equipment  behind  other  equipment  or  people. 

_ Viewing  angle  from  seat  to  equipment  not  good. 

- Other,  specify: 


Check  any  noise  problems  encountered  during  this  task: 


Could  not  hear  radio . 

Could  not  hear  other  crew  members. 
Noise  produced  fatigue. 

Noise  disturbed  concentration. 
Noise  produced  discomfort. 

Noise  gave  away  location. 

Other,  specify: _ 


MOTION 

Check  any  motion  problems  encountered  during  this  task: 

_ Vibration  affected  accurate  use  of  controls. 

_ Vibration  affected  accurate  reading  of  displays. 

_ Constant  vibration  produced  fatigue. 

_ Vibration  affected  detection/identification  of  objects 

outside  the  workstation. 

_ Acceleration  too  great  for  the  kind  of  seat  support. 

_ Acceleration  prevented  reaching  control. 

_ Acceleration  prevented  seeing  display. 

_ Kind  of  motion  nausea. 

_ Other,  specify: _ _ _ 

VENTILATION: 

Check  any  ventilation  problems  encountered  during  this  task: 

_ Much  too  hot. 

_  Much  too  cold. 

_ Much  too  hunid. 

_ Not  enough  fresh  air  flow. 

_  Exhaust  fumes  too  strong. 

_ Gun/rocket  fire  products  too  strong. 

_ Bad  odors  produced  nausea. 

_ Other,  specify: _ _ 

What  was  the  effect  of  ventilation  in  the  workstation  on  the  performance 
of  this  task: 


WORKSTATION  DIMENSIONS 

Check  any  problems  with  the  dimensions  of  the  workstation  encountered 
during  this  task: 

_ Work  surface  too  small. 

_ Work  surface  in  wrong  place. 

_ Work  surface  at  wrong  height  or  angle. 

_ Not  enough  space  to  work  because  of  equipment,  or  space 

al lowed. 

_ Not  enough  space  to  work  because  of  other  crew  members. 

_ Poor  arrangement  of  equipment. 

_ Hatches  too  small. 

_ Hatches  in  wrong  places. 

_ Other,  specify: _ 

SEATING 

Check  any  seating  problems  encountered  during  this  task: 

_ Seat  too  narrow. 

_ Seat  at  wrong  height. 

_ Not  enough  back  support. 

_ Seat  back  angle  not  right. 

_ Needs  arm  supports. 

_ Needs  foot  supports. 

_ Not  enough  head  space. 

_ Not  enough  shoulder  space. 

_ Not  enough  leg  space. 

_ Not  enough  foot  space. 

_ Seat  does  not  absorb  vibrations  well  enough. 

_ Seat  uncomfortable  and  makes  you  tired. 

_ Seat  needs  to  move  or  move  more. 

_ Other,  specify: _ 


SAFETY  HAZARDS 

Check  any  safety  hazards  encountered  at  the  workstation  during  this  task: 

_ Sharp,  jagged,  pointed  object(s). 

_ Dangerous  lack  of  head  clearance. 

_ Dangerously  hot  material  exposed. 

_ Source  of  electric  shock  exposed. 

_ Poisonous  material  exposed. 

_ Moving  machinery  exposed. 

_ So  little  light  that  accident  could  result. 

_ Glare  so  bright  that  accident  could  result. 

_ Dangerously  high  noise  level. 

_ Dangerous  lack  of  ventilation. 

_ Anchoring  of  equipment  not  adequate. 

_ Padding  of  equipment  not  adequate. 

_ Crew  seat  belts/restraints  not  adequate. 

_ Slippery  walking  or  climbing  surface. 

_ Handholds  for  lifting  or  climbing  not  adequate. 

_ Footholds  for  climbing  not  adequate. 

_ No  adequate  signal  when  equipment  operation  becomes  dangerous. 

_ No  adequate  signal  when  outside  situation  becomes  dangerous. 

_ Other,  specify: _ 

TRAINING  METHOD 

How  was  this  task  trained? 

_ Lecture . 

_ Film  or  other  audio-visual  method. 

_ Reading  printed  material. 

_ Paper  and  pencil  workbook. 

_ Practice  in  a  simulator. 

_ Watching  someone  doing  it. 

_ Doing  it  yourself  with  the  actual  hardware. 

_ Other,  specify: _ 


6.  ANALYSIS 


CONTENTS: 
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TASK  EVALUATION  WORKSHEET 


SYSTEM  TESTED: _ 

OT: _  DATE  OF  TEST: _  EVALUATOR: _ 

PHONE  #  OF  EVALUATOR: _ 

TYPE  OF  ANALYSIS:  TRAINING  :  HFE  :  PERSONNEL  SELECTION 


TASKS  TO  BE  ANALYZED 


CONDITIONS  IN  WHICH  EACH 
TASK  PERFORMED  INADEQUATELY 


TRAINING  MEASURES 


CONTENTS: 
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1.  Training  Time  Allocation  S  6-13 

2.  Practice  Conditions  Adequacy  S  6-23 

3.  Compatibility  of  Training  Methods  and  Required  Skills  S  6-27 

4.  Adequacy  of  Personnel  Who  Trained  Task 
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GENERAL  INSTRUCTIONS  FOR  TRAINING  MEASURES 


DESCRIPTION:  An  operational  test  (OT)  has  been  completed  recently.  For 
the  specifics  of  this  OT  see  the  "Task  Evaluation  Worksheet"  of  this 
submission.  Various  operator  and  maintainer  tasks  were  measured  during 
this  OT.  One  or  more  of  these  tasks  were  evaluated  as  having  been  performed 
inadequately. 

Operational  testing  and  evaluation  personnel  have  determined  that  those 
tasks  that  are  listed  are  of  significant  importance  to  the  overall  evalua¬ 
tion  of  the  system  that  was  tested.  They  need  to  know  why  these  tasks 
were  performed  inadequately.  One  possible  reason  is  that  the  training 
of  these  tasks  was  in  some  way  inadequate. 

Now  you  will  have  to  decide  which  of  the  measures  to  take  for 
each  task.  During  the  OT,  players  and  observers  filled  in  questionnaires 
in  which  they  gave  their  opinions  of  the  difficulty  of  each  tasks  and  the 
reasons  for  significant  difficulty.  The  questionnaire  scores  may  be  helpful 
to  you  in  deciding  which  training  measures  to  take.  If  a  score  indicates 
significant  difficulty,  it  is  reasonable  to  take  the  corresponding  training 
measure  for  that  task.  It  is,  of  course',  possible  that  players  and 
observers  were  not  able  to  judge  whether  there  was  something  about  training 
which  was  inadequate  and  produced  inadequate  task  performance.  Therefore, 
these  scores,  if  they  are  available,  can  only  be  a  guide  for  you  to  use  as 
you  think  best. 
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(1)  Examine  the  player  and  observer  questionnaires  for  the 
collected  tasks.  Use  these  questionnaire  data  as  an  aid 
to  selecting  parallel  training  measures.  If  you  do  not 
have  one  or  more  such  questionnaires,  use  your  best  judgment 
for  deciding  which  measures  to  take  of  each  task. 

(2)  When  you  are  finished  taking  the  measures  you  have  selected 
for  each  task,  make  as  many  copies  of  the  "Summary  Worksheet 
for  Training  Analysis  as  you  need  for  the  tasks  you  have 
diagnosed  (one  per  task). 

(3)  Fill  in  the  information  at  the  top  and  extreme  bottom  of 
each  worksheet. 

(4)  Record  the  Indices  of  Adequacy  for  each  training  measure 
you  have  taken  for  each  task  being  diagnosed.  This  is  to  be 
done  in  the  appropriately  labeled  boxes  on  the  worksheets. 

(5)  If  you  have  not  taken  a  specific  training  measure  for  a 
given  task,  and  if  you  have  questionnaires  for  that  task, 
use  the  appropriate  questionnaire  scale  score  as  an  Index 
of  Adequacy.  Record  this  questionnaire  based  score(s)  in 
the  appropriately  labeled  box. 

(6)  If  you  have  not  taken  a  specific  training  measure  for  a 
given  task,  and  if  you  do  not  have  a  questionnaire  for 
that  task,  record  an  "X"  in  the  appropriate  box. 

(7)  Next  to  each  Index  of  Adequacy  record  an  "EXP  or  "QUEST" 
in  the  third  column  of  the  worksheet.  "EXP"  is  recorded 
next  to  an  Index  which  was  based  on  an  expert  measure  you 
have  taken.  "QUEST"  is  recorded  next  to  an  Index  which 
was  based  on  a  questionnaire  scale. 


(8)  Record  the  specific  training  problem(s)  which  caused 
any  Index  of  Adequacy  to  be  significantly  below  100. 

This  is  to  be  done  in  the  first  column  of  the  worksheet. 

(9)  Compute  the  mean  of  Indices  of  Adequacy  for  each  task 
diagnosed.  If  you  have  recorded  an  "X"  in  any  bbx, 
leave  it  out  of  the  computation.  Record  the  mean  in 
the  Training  box  at  the  extreme  right  of  the  worksheet. 

(10)  When  you  have  completed  the  training  measures  and  the 
"Sumnary  Worksheet  for  Training  Analysis"  return  all 
materials  to  the  sender. 

NOTE:  Two  of  these  measures  require  data  that  should  be  collected  in 
the  "OT  Training  Data  Collection  Worksheets."  Ideally  these  worksheets 
should  be  completed  by  OT  training  personnel  during,  or  immediately  after, 
OT  training. 
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GUIDELINES  FOR  COMPLETING  OT 
TRAINING  DATA  COLLECTION  WORKSHEET 


You  are  asked  to  record  the  amount  of  time  required  for  training.  This 
package  includes  the  Guidelines  you  are  reading;  a  list  of  tasks  that  you 
trained;  and  the  "OT  Training  Data  Collection  Worksheet."  Immediately 
following  OT  Training,  fill  out  the  "OT  Training  Data  Collection  Worksheet." 
The  following  instructions  will  aid  you  in  completing  the  Worksheet: 

(1)  List  the  tasks  you  trained  in  the  left-hand  column 

of  the  Worksheet.  Examine  the  enclosed  list  of  tasks 
and  select  those  you  have  trained. 

(2)  Potential  training/practice  methods  are  listed  on  the 
matrix  edge.  If  you  used  a  method  not  listed,  add  it. 

(3)  Each  cell  should  be  filled  in  with  the  number  of  hours 
or  fraction  of  hours  used  to  train  each  task  according 
to  each  training  method. 

(4)  Add  across  each  row  to  determine  the  "sum"  of  total 
training  and  practice  time  for  a  given  task. 

(5)  Return  the  Worksheet  to  the  sender  to  be  included  with 
other  test  documentation. 


Or  TRAINING  D/TA  COLLECTION  WORKSHEET 


TRAINING  MEASURE  Ul 

MEASURE  OF  TRAINING  TIME  ALLOCATION  (ALTERNATIVE  1) 


DESCRIPTION:  This  measure  compares  the  length  of* time  devoted  to  training 
the  task  that  is  being  diagnosed  with  the  length  of  time  devoted  to  training 
a  baseline  task.  To  use  this  measure  the  following  requirements  must  be 
met: 


(1)  You  must  have  access  to  a  task  list  for  a  functionally 
similar  system. 

(2)  This  list  must  contain  a  similar  task.  Usually  this  will 
be  the  system  being  replaced  by  the  one  which  has  been 
tested. 

(3)  You  have  no  reason  to  suspect  that  the  baseline  task  is 
significantly  more  difficult  to  perform  than  the  task  being 
diagnosed. 

(4)  You  have  access  to  data  which  includes  the  length  of  time 
devoted  to  training  this  baseline  task. 

(5)  You  have  no  reason  to  suspect  that  this  baseline  task  was 
performed  in  an  unsatisfactory  manner. 

(6)  You  have  no  reason  to  suspect  that  the  personnel  who  performed 
the  baseline  task  had  inferior  aptitudes  to  those  who 
performed  the  task  being  diagnosed. 

(7)  The  training  of  the  task  being  diagnosed  has  not  improved 
in  a  way  that  would  require  less  training  time  than  the 
baseline  task. 

If  you  have  this  information,  the  task  can  be  used  as  a  baseline  for 
training  time.  Under  these  circumstances  it  would  be  plausible  to  assume 
that  the  task  being  analyzed  should  have  received  at  least  as  much  training 
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time  as  the  baseline  task.  However,  this  required  information  will  probably 
not  be  available  in  the  early  tests  in  which  HRTES  is  used.  As  HRTES 
continues  to  be  used,  this  required  data  should  become  available. 

PROCEDURE: 

(1)  Determine  if  you  can  meet  all  seven  requirements  for  the 
use  of  this  measure.  If  not,  read  alternative  #2.  If  you 
can  meet  them,  copy  "Worksheet  for  Training  Time  Allocation 
Measure  (Alternative  1}"  on  page  S6-15  for  tasks  to  be 
diagnosed. 

(2)  Fill  in  the  required  information  on  your  copy  of  the  worksheet. 

(3)  Divide  the  training  time  of  the  task  being  diagnosed  by  the 
training  time  of  the  baseline  task,  and  record  it.  If  the 
resulting  quotient  is  greater  than  1.0,  record  it  as  1.0. 

A  number  larger  than  this  provides  no  additional  diagnostic 
information. 

(4)  Multiply  the  resulting  quotient  by  100,  and  record  it  on 
the  worksheet.  This  is  what  HRTES  refers  to  as  the  Index 
of  Adequacy  for  this  measure  of  training  time.  The  further 
this  Index  is  below  100,  the  greater  the  likelihood  that 
insufficient  time  was  devoted  to  training  the  task. 


WORKSHEET  FOR  TRAINING  TIME  ALLOCATION  MEASURE 

(ALTERNATIVE  1) 

TASK  BEING  ANALYZED _ 

SIMILAR  BASELINE  SYSTEM: _ 

BASELINE  TASK:  _ _ 

TRAINING  TIME  FOR  DIAGNOSED  TASK: _ 

TRAINING  TIME  FOR  BASELINE  TASK: _ 

ANALYZED  TASK/BASELINE  TASK  (1.0  MAXIMUM)  =  _ 

INDEX  OF  ADEQUACY  FOR  TRAINING  TIME 

(MULTIPLY  QUOTIENT  ABOVE  BY  100)  - 


TRAINING  MEASURE  #1 

MEASURE  OF  TRAINING  TIME  ALLOCATION  (ALTERNATIVE  2) 

DESCRIPTION:  The  amount  of  time  spent  training  a  task  ought  to  be  related 
to  its  criticality  and  difficulty.  This  measure  requires  the  determination 
of  the  criticality  and  difficulty  of  a  task  that  is  being  diagnosed  and  of 
five  randomly  selected  tasks  that  were  successfully  performed.  Criticality' 
and  difficulty  of  tasks  is  determined  by  rating. 

Once  you  have  determined  the  criticality  (C)  and  difficulty  (D)  of  each 
of  the  six  tasks,  you  calculate  the  training  time  per  unit  of  criticality 
X  difficulty  (T/CXD)  for  each.  You  then  compare  this  statistic  for  the 
task  being  diagnosed  with  the  mean  of  this  statistic  for  the  five  success¬ 
fully  performed  tasks.  If  the  training  time  of  the  task  being  diagnosed 
was  insufficient,  there  should  be  a  significant  difference  between  its 
statistic  and  the  mean  statistics.  If  such  a  significant  difference  does 
not  exist,  you  cannot  assume  a  training  time  insufficiency.  In  this  measure 
a  significant  difference  is  defined  as  one  standard  deviation. 

PROCEDURE: 

(1)  Select  five  tasks  that  were  successfully  performed  in  this 
OT  (to  accompany  the  one  unsuccessfully  performed  task  that 
is  being  analyzed). 

(2)  Rate  the  difficulty,  criticality  for  each  of  the  six  tasks 
on  the  accompanying  scales. 


DIFFICULTY 


1 _ 25 _ 50 _ 75 _ 100 

Task  not  atall  Task  moderately  Task  extremely 

difficult  to  difficult  to  difficul t  to 

perform  perform  perform 

CRITICALITY 

.t 

0.1 _ ,25 _ 15 _ J5 _ KO 

If  task  not  performed,  If  task  not  performed  If  task  not 

no  effect  on  system  some  impact  on  system  performed, 

capability  performance,  but  system  fails 

success  possible 

(3)  You  now  have  six  tasks,  and  each  one  has  a  criticality  and  a 
difficulty  weight.  Multiply  these  two  weights  for  each 
task,  and  record  the  products  in  the  appropriate  cells  of 

the  "Training  Time  Allocation  Measure  Alternative  2  Worksheet.' 

(4)  Retrieve  the  "OT  Training  Data  Collection  Worksheets" 
completed  by  the  Trainers  during  this  operational  test. 

Copy  the  training  time  for  each  task  from  this  worksheet 

on  to  your  "Training  Time  Allocation  Measure  (Alternative  2) 
Worksheet. " 

(5)  Divide  each  task's  training  time  by  its  criticality  X 
difficulty  product,  and  record  the  resulting  quotient  on 
the  worksheet. 

(6)  Compute  the  mean  of  quotients  from  Step  5.  However,  this 
is  the  mean  only  for  successfuly  performed  tasks. 


(7)  Compute  the  standard  deviation  of  the  last  (fourth) 
column  for  only  the  successful ly  performed  tasks. 

Enter  it  in  the  standard  deviation  box. 

Standard  Deviation  Formula: 

SD  =  l  (X-Y)2 
N-l 

Where: 

X  =  the  values  in  column  4  of  the  worksheet  for  the  success¬ 
fully  performed  tasks. 

Y  =  column  4  mean  of  the  successfully  performed  task. 

N  =  number  of  successfully  performed  task's  listed  on 
the  worksheet. 

(8)  If  the  quotient  (  Train_i  ng_Tjme  ^  the  ^eing  ana  ly  zed 
falls  within  one  SD  of  the  mean  of  the  successful  tasks, 
record  100  for  the  Index  of  Adequacy.  In  this  case  it  is 
impossible  to  assume  that  training  time  was  unacceptable. 

(9)  If  this  quotient  does  not  fall  within  one  SD  of  the  mean: 

(a)  Divide  the  quotient  of  the  task  being  analyzed  by 
the  mean  quotient  (from  Step  6). 

(b)  Multiply  the  resulting  quotient  by  100. 

(c)  This  is  the  Index  of  Adequacy.  The  farther  it  is 
below  100,  the  greater  the  chance  that  training  time 
was  inadequate. 


TRAINING  TIME  ALLOCATION  MEASURE 
ALTERNATIVE  2  WORKSHEET 


SUCCESSFULLY  PERFORMED  TASKS 


CRITICALITY 
x  DIFFICULTY 
(2) 


TRAINING 

TIME 

(3) 


(3)  +  (2) 


UNSUCCESSFUL  TASK 
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KAIUINU  I  I  Me  ALLOLAliuN  MtAbUKt 
ALTERNATIVE  !'  W ;  T R K L MEET 


EXAMPLE  FOR  ML  A,: 


ALT  t.RNAT  1  VE 


SUCCESSFULLY  PERFORMED  TASKS 


CRITICALITY 
x  DIFFICULTY 
(2) 


TRAINING 

TIME 

(3) 


STANDARD  DEVIATION 


INDEX  OF  ADEQUACY 
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(3)  +  (2) 


1.  Select  tarqet  and  tarqet  order. 

.  (c  X  30  -  /? 

A  Ars 

t*a/ 

2.  Perform  misfire  procedure. 

.3 

<?  Ars. 

.3  r 

3.  Fire  weapon. 

.SyCAC'.S’ 

5- ArS- 

/ 0.0 

4.  Perform  ground  vehicle  maneuvers. 

3/&0  */f 

S’  Ars . 

5.  Fuel  ground  vehicle. 

■  U/O'AO 

<=2-  Ars 

c2  .0 

UNSUCCESSFUL  TASK 

1.  detect  and  Identify  target. 

■t*  xf 

/  u 

•  03L 

MEAN 

.  f5~ 

*  b  7 


<2 , 3  S' 


TRAINING  MEASURE  # 2 

MEASURE  OF  THE  ADEQUACY  OF  PRACTICE  CONDITIONS 

DESCRIPTION:  The  amount  and  nature  of  practice  is  likely  to  have  a 
considerable  effect  on  the  adequacy  of  task  performance.  If  a  task  were 
performed  inadequately  under  a  given  condition  or  set  of  conditions,  and 
if  you  discovered  that  it  had  not  been  trained  under  these  conditions, 
you  might  suspect  that  this  practice  had  been  inadequate.  Further,  you 
might  suspect  that  such  an  inadequate  practice  was  a  cause  of  the 
inadequate  performance  of  the  task.  This  measure  is  based  on  expert 
opinion  of  the  adequacy  of  practice  which  took  place  for  the  task  being 
analyzed.  The  individual  who  produces  this  expert  opinion  should  know: 

(1)  what  conditions  were  in  force  during  task  practice; 

(2)  the  amount  of  time  devoted  to  practicing  various  tasks; 

(3)  the  number  of  practice  trials  for  each  task;  and 

(4)  how  the  practice  was  carried  out  in  terms  of  realism. 

PROCEDURE: 

(1)  Complete  all  "Practice  Condition  Worksheets,"  by  answering 
the  questions  and  determining  the  appropriate  rating. 

(2)  If  more  than  one  condition  was  in  force  for  an  inadequately 
performed  task,  make  an  additional  copy  of  the  blank 
"Practice  Condition  Worksheet."  Write  "Mean"  in  the 
"Condition  Box." 
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(3)  Compute  the  mean  ratings  of  all  conditions  rated  for  each 
task  being  analyzed.  Record  this  in  the  "Rating  Box"  of 

the  Mean  Worksheet.  This  is  the  Index  of  Adequacy  of  Practice 
Conditions  for  this  task.  The  further  it  is  below  100,  the 
less  adequate  the  total  practice  for  this  task. 

(4)  If  any  condition  received  a  rating  of  zero  because  both 
questions  1  and  2  were  answered  "NO,"  it  should  be 
specifically  noted.  Even  though  adequate  practice  of 

a  number  of  other  conditions  may  raise  the  final  Index, 
the  presence  of  any  zero  could  point  to  the  actual  cause 
of  inadequate  performance.  Therefore,  when  the  overall 
Index  is  reported,  the  total  absence  of  a  condition 
in  practice  or  the  absence  of  its  "good  replacement" 
should  also  be  reported  as  a  possible  cause. 
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prac  r  i  oh  c i  nor:  worksheet 

TASK: _ 

CONDITION: 


1.  Was  the  above  task  practiced 
under  the  above  condition? 

2.  If  the  answer  to  number  1  was 
"NO,"  was  there  a  condition  that 
was  a  good  substitute? 

If  the  answer  to  this  question  is 
"YES,"  list  the  substitute 
condition  here  - ► 

3.  If  the  answer  to  either  questions 
1  or  2  was  "YES,"  fill  out  the 
rating  form  below,  and  return  the 
complete  worksheet  to  sender. 

If  the  answer  to  both  questions  1 
and  2  was  "NO,"  ignore  the  rating 
form  below,  and  return  it  to  sender. 


PRACTICE  CONDITION  RATING  FORM 


Rate  the  quality  of  the  practice  of  the  task 
under  this  condition  (or  substitute  condition). 

This  rating  should  include  your  consideration  of  the  adequacy  of: 

(1)  Practice  time 

(2)  Number  of  practice  trials 

(3)  Realism  of  practice. 

(4)  Realism  of  practice  hardware/software. 

Your  rating  is  to  be  made  on  the  scale,  as  indicated  here.  Any  number 
between  0  and  100  can  be  given. 


0 _ | _ 50 

Practice 

Completely 

Inadequate 

ENTER  YOUR  RATING  HERE  - »►  f 


100 

Practice 

Completely 

Adequate 
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TRAINING  MEASURE  #3 

MEASURE  OF  COMPATIBILITY  OF  TRAINING  METHODS 
AND  SKILLS  REQUIRED  FOR  THE  TASK 

DESCRIPTION:  When  someone  performs  a  task,  he  or  she  is  simply  exercising 
one  or  more  skills.  The  level  of  the  skills  will  have  a  significant  effect 
on  the  task's  level  of  performance.  Skill  level  is  the  outcome  of  a 
combination  of  training  and  the  cha racteri sties  of  the  individual.  Training 
to  enhance  skill  level  is,  itself,  a  combination  of  previous  formal  and 
informal  training  and  current  training  directed  toward  the  specific  system 
being  tested. 

All  training  methods  are  not  equally  good  at  training  all  types  of  skills. 
Each  type  of  skill  has  one  or  more  particularly  applicable  training  methods. 
The  less  appropriate  the  training  method  used,  the  higher  the  probability 
that  the  skill  will  not  be  enhanced.  If  a  task  being  analyzed  required 
skills  that  were  trained  by  inappropriate  methods,  you  would  have  reason 
to  suspect  that  these  skills  were  not  adequately  enhanced.  Further,  you 
might  suspect  that  this  was  a  cause  of  inadequate  task  performance.  To 
aid  you  in  understanding  this  measure,  a  complete  set  of  examples  has  been 
included. 

PROCEDURE: 

(I)  Retrieve  the  "OT  Training  Data  Collection  Worksheets"  for 
the  tasks  being  analyzed. 


(2)  Examine  the  appropriate  "OT  Training  Data  Collection  Worksheet" 
for  the  task.  Copy  the  percentages  of  training  time  devoted 
to  each  training  method  from  the  above  worksheet  to  the 
right-hand  column  of  Worksheet  #1. 
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(3)  Examine  Worksheet  #2  for  the  task  being  diagnosed,  and 
determine  which  of  the  six  global  skill  types  listed  are 
required  for  the  performance  of  this  task. 

(4)  When  you  have  decided  which  skill  types  are  required,  estimate 
the  percentage  of  each  required  skill  that  must  be  present 

in  the  performance  of  this  task.  These  percentages  must 
sum  to  100.  Record  the  percentages  in  the  appropriate 
column  of  Worksheet  #2. 

(5)  Next,  you  must  estimate  the  utility  of  each  training  method 
that  was  actually  used  in  the  training  of  each  required 
skill  (for  this  task).  Training  methods  not  actually  used 
and  skills  not  required  will  not  play  a  part  in  this  utility 
rating  procedure.  There  are  two  alternative  methods  for 
making  this  estimate  of  training  method  utility  for  skills: 

(a)  Complete  the  "Utility  Estimate  Worksheet,"  for  the 
system  which  was  tested  in  the  OT.  This  will  be 
time  consuming  and  somewhat  difficult,  but  it  will 
represent  your  thinking  (or  the  thinking  of  some 
other  individual  who  you  get  to  complete  this 
worksheet)-,  or 

(b)  Obtain  utility  ratings  from  Table  6-1.  The  utility 
ratings  in  this  table  were  made  by  training  experts, 
and  were  based  on  synthesis  of  a  large  body  of 
applicable  research. 

(6)  One  way  or  another,  you  now  have  determined  the  utility  of 
each  training  method,  actually  based,  for  training  each 


SKILLS 


TRAINING  METHODS 


ORAL/WRITTEN  DRILL  PRACTICE 


LECTURE 


INDIVIDUAL  0 1 SCUSS I  ON 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATI  ON /VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


GAMES 


SIMULATION 


HANDS  ON  PRACTICE— REAL  HARDWARE 
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DECISION  MAKING 


required  skill.  Enter  these  utility  ratings  in  the 
appropriate  cells  of  Worksheet  #1  for  the  task  being 
analyzed.  Only  enter  the  uti 1 i ty  ratings  for  those 
skills  actually  required  (from  Worksheet  #2),  and  for 
those  training  methods  actually  used. 

(7)  Copy  the  percentages  required  for  the  performance  of  the 
skills  (from  Worksheet  #2)  into  the  appropriate  cells  of 
the  bottom  row  of  Worksheet  #3.  Skills  which  received 
no  rating  or  a  zero  percentage  are  to  be  left  blank. 

(8)  Return  to  Worksheet  #1.  Multiply  each  number  in  the  right- 
hand  column  of  this  worksheet  by  each  of  the  ratings  by 
each  of  the  ratings  in  the  row  to  which  that  first  number 
belongs.  You  are  now  multiplying  the  percentages  of 
training  time  of  each  training  method  by  the  utility  rating 
of  each  skill  required  for  the  performance  of  the  task. 

(9)  Record  the  products  of  the  multiplication  in  procedure 

10  in  the  appropriate  cells  of  Worksheet  #3.  You  may  find 
it  helpful  to  examine  the  various  example  worksheets  at 
this  point. 

(10)  Sum  the  products  in  each  column  of  Worksheet  #3,  and  record 
each  column's  sum  in  the  second  to  the  last  row  of  this 
worksheet  ("Sum  of  Column"  row). 

(11)  Compute  the  correlation  coefficient  between  the  last  two 
rows  of  Worksheet  #3.  These  are  the  "Sum  of  Column"  row 
and  .the  "%  Of  Task  Involving  Skill"  row.  If  you  have  to 
do  this  computation  by  hand,  use  the  following  formula: 
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Computational  Formula  for  Correlation  Coefficient: 


r  -  N  t  XY  -  (  l  X)  (  l  Y) 


[  N  I  X2  -  (  l  X)2]  [  N  J  V2  -  (  l  V)2] 


Where: 

r  =  correlation  coefficient. 

N  =  number  of  skills  listed  in  Worksheet  #3. 

X  =  column  sum  (second  to  last  row  in  Worksheet  #3). 

Y  =  percent  of  task  involving  skill  (last  row  of  Worksheet  #3). 
I  =  sum  over  the  skills  in  Worksheet  #3. 

(12)  Record  the  resulting  correlation  coefficient  in  the  appropriate 
box  of  Worksheet  #3.  This  will  be  either  a  positive  or 
negative  number  from  0  to  1.0.  The  closer  it  is  to  1.0,  the 
more  appropriate  were  the  training  methods  and  times  alloted 

to  them  in  the  training  of  the  task. 

(13)  Multiply  the  correlation  coefficient  by  100,  and  record  the 
resulting  product  in  the  Index  of  Adequacy  box  of  Worksheet 
#3. 


TRAINING  METHODS  WORKSHEET  U 1 


TASK 


SKILLS 


DECISION  MAKING 


TRAINING  METHODS  WORKSHEET  Ul 
EXAMPLE 


TASK 


SKILLS 


Detect  and  identify  target 


TRAINING  METHODS 


ORAL/WRITTEN  DRILL/PRACTICE 


LECTURE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


GAMES 


SIMULATION 


HANDS  ON  PRACTICE  -  REAL  HARDWARE 


%  OF  TASK 
TRAINING  TIME 
USING  THIS  METHOD 


TRAINING  METHODS  WORKSHEET  #2 


TASK 


Enter  the  percentage  of  each  of 
the  following  skills  required  for 
the  performance  of  task  above. 


The  performance  of  all 
skills  must  sum  to  100. 


SKILLS 


KNOWLEDGE 


UNDERSTANDING 


VERBAL/WRITTEN 


PSYCHOMOTOR 


PERCEPTION 


DECISION  MAKING 


X  REQUIRED 
FOR  PERFORMANCE 


S  6-35 


t. 


TRAINING  METHODS  WORKSHEET  #2 
EXAMPLE 


TASK 


Detect  and  identify  target 


Enter  the  percentage  of  each  of 
the  following  skills  required  for 
the  performance  of  task  above. 

The  performance  of  all 

skills  must  sum  to  100.  SKII 


SKILLS _ 

KNOWLEDGE 


UNDERSTANDING 


VERBAL/WRITTEN 


PSYCHO  MOTOR 


PERCEPTION 


DECISION  MAKING 


X  REQUIRED 
FOR  PERFORMANCE 


r£0 

SUM  /  00 
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TRAINING  METHODS  WORKSHEET 


SKILLS 


ORALyWRITTEN  DRILL  /PRACTICE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


HANDS  ON  PRACTICE  -  REAL  HARDWARE 


CORRELATION 

COEFFICIENT 

INDEX  OF 
ADEQUACY 


SUM  OF  COLUMN 

%  OF  TASK 
INVOLVING  SKILL 


S  6-37 


s'  s 


TRAINING  METHODS  WORKSHEET  #3 
EXAMPLE 


Detect  and  Identify  target 


ORAl/WRtTTEN  DRILL /PRACTICE 


LECTURE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


GAMES 


SIMULATION 


HANDS  ON  PRACTICE  -  REAL  HARDWARE 
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CL 
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a. 

o 

o 

8 

CORRELATION 

COEFFICIENT 


1  .6£_ 


INDEX  OF  . 
ADEQUACY  £ 


SUM  OF  COLUMN  ^4 

%  OF  TASK  ~7~ 
INVOLVING  SKILLS  Jo 
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UTILITY  ESTIMATE  WORKSHEET 


Estimate  the  utility  of  each  listed 
Training  Method  in  the  matrix  below 
for  the  training  of  each  skill,  accord¬ 
ing  to  the  current  technology.  Your 
Utility  ratings  should  fall  between  0 
and  1.0.  Zero  means  that  this  method 
has  absolutely  no  utility  for  training  this 
skill.  1.0  means  that  this  method  is  the 
best  possible  for  training  this  skill.  The 
Utility  ratings  do  not  have  to  sum  to  1 .0 
for  a  given  skill. 

Return  to  sender  upon 
completion. 


TRAINING  METHODS 


ORAL/WRITTEN  DRILL  /PRACTICE 


LECTURE 

INDIVIDUAL  DISCUSSION 


DECISION  MAKING 


TRAINING  MEASURE 

MEASURE  OF  THE  ADEQUACY  OF  OPERATIONAL  TEST  TRAINERS 


DESCRIPTION:  One  of  the  major  variables  of  training  which  can  produce 
sub-criterion  performance  of  a  task  is  inadequate  trainer  functioning. 
Trainers'  styles  vary  considerably.  This  variation  makes  it  difficult 
to  take  meaningful  measures  of  trainer  functioning  by  observation.  Two 
other  alternatives  remain: 

(1)  measuring  attitudes  toward  trainer  performance  (carried 
out  in  HRTES  questionnaires);  and 

(2)  measuring  and  evaluating  trainer  background  experiences. 

This  latter  measure  is  based  on  the  supposition  that  the  level  of  a  trainer's 
background  will  have  a  significant  effect  on  ability  to  effectively  train 
a  task. 

In  this  measure,  you  develop  a  list  of  background  experiences  which  are 
desirable  for  training  a  task  that  is  being  analyzed.  You,  or  some  other 
training  expert  you  select,  rates  each  of  these  background  experiences  on 
a  utility  scale.  You  also  determine,  or  obtain,  estimates  of  the  minimum 
amount  of  time  required  for  each  of  these  background  experiences.  You 
then  determine  which  of  these  background  experiences  the  appropriate 
trainer(s)  had  and  the  amount  of  time  for  each  one.  Finally,  you  compare 
actual  trainer  experiences  with  those  which  were  selected  as  being 
desirable  for  training  the  task  being  analyzed. 
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PROCEDURE: 

(1)  In  the  first  column  of  the  "Index  of  Trainer  Adequacy 
Worksheet,"  list  the  specific  background  experiences 
which  a  trainer  should  have  to  effectively  train  the 
task  being  analyzed.  This  should  include:  experiences 
as  a  trainer,  if  any;  specific  operational  or  maintenance 
experiences,  if  any;  specialties  held,  if  any;  and 
educational  experiences,  if  any. 

(2)  For  each  background  experience  listed  estimate  the 
minimal  amount  of  time  required  in  the  second  column 

of  the  worksheet.  These  amounts  of  time  should  be  listed 
as  months. 

(3)  Rate  each  listed  background  activity  on  the  following 
scale.  Select  any  number  from  0-100.  It  is  understood 
that  since  you  have  already  stated  that  these  activities 
are  required,  you  will  never  rate  any  of  them  "0".  The 
lower  anchor  of  this  scale  is  presented  to  make  its 
meaning  clearer.  When  you  have  rated  a  given  background 
activity  record  the  rating  in  the  third  column  of  the 
worksheet. 


ABSOLUTELY 

NONE  MODERATE  REQUIRED 

0  25  50  75  _ 100 


No  utility  for 
training  this 
task 


Moderately  useful  for  Absolutely 

training  this  task  required  for 

training  this 
task 


S  6-12 


HUN 


(4)  Multiply  the  time  and  utility  weight  of  each  background 
experience.  Record  the  resulting  product  in  the  fourth 
column  of  the  worksheet. 

(5)  Add  the  products  in  the  fourth  column  of  the  worksheet, 
and  record  the  resulting  sum  in  the  Sum  (A)  box  of  the 
worksheet. 

(6)  Determine  if  the  trainer(s)  of  the  task  being  diagnosed 
had  each  of  these  background  experiences  (or  others  which 
were  functionally  identical).  If  the  trainer(s)  did  not 
have  an  experience,  determine  how  many  months  were  devoted 
to  it.  If  more  than  one  trainer  trained  the  personnel 
who  performed  this  task  inadequately,  compute  the  means 

of  the  months  of  the  experiences.  If  the  actual  trainer 
time  for  any  given  background  experience  is  greater  than 
the  minimum  acceptable  time  (which  has  been  recorded), 
record  the  minimum  acceptable  time.  Do  not  record  the 
actual  trainer  time.  Without  this  truncation  it  would 
be  possible  for  large  amounts  of  experience  in  one  area  to 
entirely  obscure  a  total  absence  in  another.  If  the 
actual  trainer  time  is  less  than  the  minimum  acceptable 
time,  record  it  directly. 

(7)  Multiply  the  utility  weight  of  each  background  experience 
(from  the  second  column)  by  the  actual  trainer  time  of 
that  experience  (from  the  fifth  column).  Record  the 
resulting  products  in  the  sixth  column  of  the  worksheet. 

(8)  Add  these  products,  and  record  the  resulting  sum  in  the 
Sum  (B)  box  on  the  worksheet. 


.  -  w.v 
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(9)  Divide  Sum  (B)  by  Sum  (A).  Multiply  the  resulting 

quotient  by  100.  Record  the  resulting  product  in  the 
Index  box  of  the  worksheet.  This  is  the  Index  of 
Adequacy  of  Trainer  Background  for  the  task.  If  the 
trainer's  background  is  entirely  appropriate  for  training 
this  task,  the  Index  will  be  approximately  100.  The 
less  adequate  the  background,  the  further  the  Index  will 
be  below  100. 
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SPECIFIC  TRAINING  PROBLEMS 
CONTRIBUTING  TO  INDICES 


EXP  TRAINING 
TRAINING  MEASURE  .  OR  INDEX  OF 
INDICES  OF  ADEQUACY  QUEST  ADEQUACY 


HUMAN  FACTORS  ENGINEERING  (HFE)  MEASURES 

CONTENTS : 


MEASURE:  •  PAGE: 

1.  Understandabi 1 i ty  of  Procedure  S  6-57 

2.  Difficulty  of  Decisions  S  6-63 

3.  Display  Information  Adequacy  $  6-73 

and  Timeliness 

4.  Display  Readability/  S  6-79 

Hearability 

5.  Display  Information  S  6-87 

Understandabi 1 i ty 

6.  Control  Accessibility  S  6-93 

7.  Control  Static  S  6-99 

Characteri sties 

8.  Control  Dynamic  S  6-105 

Characteri sti cs 

9.  Workstation  Dimensional  S  6-111 

Characteristics 


CONTENTS  (Continued): 


MEASURE:  PAGE: 

10.  Workstation  Seating  S  6-113 

Characteri sties 

11.  Workstation/Environment  S  6-115 

Visual  Characteristics 

12.  Workstation/Environment  S  6-117 

Sound  Characteristics 

13.  Workstation  Motion  S  6-119 

Characteristics 

14.  Workstation/Environment  S  6-121 

Ventilation  Characteristics 

15.  Workstation/Environment  S  6-123 

Safety  Characteri sties 
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GENERAL  INSTRUCTIONS  FOR  HUMAN  FACTORS 
ENGINEERING  (HFE)  MEASURES 

DESCRIPTION:  An  operational  test  (OT )  has  been  completed  recently.  For 
the  specifics  of  this  OT,  see  "Task  Evaluation  Worksheet"  of  this  submis¬ 
sion.  Various  operator  and  maintainer  tasks  were  measured  during  this  OT. 
One  or  more  of  these  tasks  was  evaluated  as  having  been  performed  inade¬ 
quately. 

Operational  testing  and  evaluation  personnel  have  determined  that  those 
tasks  that  are  listed  are  of  significant  importance  to  the  overall 
evaluation  of  the  system  that  was  tested.  They  need  to  know  why  these 
tasks  were  performed  inadequately.  One  possible  reason  is  that  the  human- 
machine  interface,  or  the  actual  procedure  itself,  was  inadequate  in  some 
way,  and  this  inadequacy  was  a  cause  of  the  level  of  performance. 

This  section  includes  a  set  of  "General  Procedures"  that  applies  to  all_  of 
the  listed  HFE  measures.  Each  of  the  first  8  measures  has  its  own  specific 
procedures  that  accompanies  the  measure  worksheet.  Measures  9-15  have  a 
common  set  of  procedures.  These  procedures  apply  to  each  of  these  measures 
They  are  listed  in  this  section  and  are  entitled  "Common  Procedures  for 
Measures  9-15."  Measure  16,  "Workload"  is  entirely  based  on  the  "Workload 
Scale"  found  in  the  Player  and  Observer  Questionnaires  for  the  task  being 
diagnosed. 

Your  first  problem  will  be  to  decide  which  of  these  measures  to  take  of 
each  task.  During  the  OT,  players  and  observers  filled  in  questionnaires 
in  which  they  gave  their  opinions  of  the  difficulty  of  each  task  and  the 
reasons  for  significant  difficulty.  If  any  player  or  observer  thought  that 
performing  a  given  task  was  difficult  and  that  task  is  one  of  those  being 
analyzed  now,  you  will  have  a  Questionnaire  for  it.  In  this  case,  the 
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scale  scores  listed  may  be  helpful  to  you  in  deciding  which  HFE  measures 
to  take.  If  a  score  indicates  significant  difficulty  (50  or  below)  it  is 
reasonable  to  take  the  corresponding  HFE  measure  for  that  task.  It  is, 
of  course,  possible  that  players  and  observers  were  not  able  to  judge 
whether  there  was  something  which  was  inadequate  and  produced  inadequate 
task  performance.  Therefore,  these  scores,  if  they  are  available,  can 
only  be  a  guide  for  you  to  use  as  you  think  best. 

GENERAL  PROCEDURE  (APPLIES  TO  ALL  HFE  MEASURES): 

(1)  Examine  the  Questionnaires  for  each  task.  Use  their  scores 
as  an  aid  to  selecting  parallel  HFE  measures.  If  you  do  not 
have  one  or  more  such  questionnaires,  use  your  best  judgment 
for  deciding  which  measures  to  take  of  each  task. 

(2)  When  you  have  finished  taking  the  measures  you  have  selected 
for  each  task,  make  as  many  copies  of  the  "Sunmary  Worksheet 
for  the  HFE  Analysis"  as  you  need  for  the  tasks  you  have 
analyzed. 

(3)  Fill  in  the  information  at  the  top  and  extreme  bottom  of  each 
worksheet. 

(4)  Record  the  specific  HFE  indices  of  adequacy  for  the  measures 
you  have  taken  for  each  task  being  analyzed.  This  is  to  be 
done  in  the  appropriately  labeled  boxes  on  the  worksheets. 

(5)  If  you  have  not  taken  a  specific  HFE  measure  for  a  given  task, 
and  if  you  have  Questionnaires  for  that  task,  use  the  appro¬ 
priate  questionnaire  scale  score  as  an  Index  of  Adequacy.  In 
the  case  of  "Workload,"  this  will  always  be  the  case.  Record 
the  questionnaire  based  score(s)  in  the  appropriate  labeled 
box. 
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(6)  If  you  have  not  taken  a  specific  HFE  measure  for  a  given  task, 
and  if  you  do  not  have  a  questionnaire  for  that  task,  record 
an  "X"  in  the  appropriate  box. 

(7)  Next  to  each  specific  index  of  adequacy  record  an  "EXP"  or 
"QUEST"  in  the  third  colunn  of  the  worksheet.  "EXP"  is  re¬ 
corded  next  to  an  Index  which  was  based  on  an  expert  measure, 
you  have  taken.  "QUEST"  is  recorded  next  to  an  index  which 
was  based  on  a  questionnaire  scale  for  that  HPF. 

(8)  Record  the  specific  HFE  problem(s)  that  caused  any  specific 
index  of  adequacy  to  be  signi ficantly  below  100.  This  is  to 
be  done  in  the  first  column  of  the  worksheet.  If  necessary, 
append  an  addition  sheet  for  this  explanatory  purpose,  and 
reference  it  in  the  first  column. 

(9)  Compute  the  means  of  the  specific  indices  of  adequacy  accor¬ 
ding  to  the  branching  structure  on  the  worksheet.  Means  are 
to  be  computed  of  Indices:  1+2  +  3  +  4  +  5  +  6  +  7+  8  + 

9  +  10  +  11  +  12  +  13  +  14  +  15.  Measure  16,  Workload,  is 
simply  transferred  to  the  next  box.  If  you  have  recorded  an 
"X"  in  any  box,  leave  it  out  of  the  computation.  Record  the 
resulting  means  in  the  appropriate  boxes  for  Collective 
Indices . 

(10)  If  aJJ_  of  the  specific  indices  are  absent,  for  a  given  collec¬ 
tive  index,  record  an  "X"  in  the  box  for  that  collective  index. 

(11)  Compute  the  mean  of  the  collective  indices.  If  you  have 
recorded  an  "X"  in  any  collective  index  box,  leave  it  out  of 
the  computation.  Record  the  mean  in  the  Human  Factors  Engin¬ 
eering  Box  at  the  extreme  right  of  the  worksheet. 


(12)  When  you  have  completed  the  HFE  measures  and  the  "Summary 
Worksheet  for  HFE  Analysis"  return  all  materials  to  the 
sender. 

COMMON  PROCEDURES  FOR  MlASURES  9  THROUGH  14: 

(1)  Study  the  characteristics  listed  on  the  worksheet.  If  you 
think  that  a  significant  characteristic  is  missing,  add  it 
in  the  "Other"  category. 

(2)  Decide  if  each  characteristic  on  the  worksheet  is  relevant  to 
the  performance  of  the  task  being  analyzed  in  this  system. 

If  it  might  have  a  significant  effect  on  task  performance  in 
this  system,  it  is  relevant.  In  this  case,  record  an  "X"  in 
the  appropriate  cell  of  the  Relevance  Column.  If  a  character¬ 
istic  is  not  relevant,  record  a  "0"  in  the  cell. 

(3)  Rate  each  characteristic  that  you  have  selected  on  the  criti¬ 
cality  scale  which  follows.  Select  any  rating  from  1-100. 
Record  the  ratings  in  the  appropriate  cells  of  the  Rating 

Co  1 umn . 

LOW  CRITICALITY  MODERATE  CRITICALITY  HIGH  CRITICALITY 

1  25  50  75  100 

Just  important  enough  Criticality  moderate  Criticality  extremely 

to  be  measured.  Criti-  for  this  task.  high  for  this  task, 

cality  low  for  this  task. 

(4)  Obtain  appropriate  measurements  of  each  characteristic  you 
have  selected.  This  may  be  done  in  the  following  ways: 


(a)  Obtaining  appropriate  measurements  from  previous  OT’s, 
OT's,  HFE  tests,  or  other  reasonably  reliable  sources. 

(b)  Physically  taking  the  necessary  measurements  from  the 
actual  system. 

(c)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 

(5)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 

(a)  Comparison  with  reasonably  valid  specifications  such  as 
those  found  in  MIL  STD-1472,  HEDGE,  and  HFTEMAN— this 
is,  of  course,  preferable. 

(b)  Evaluation  based  on  expert  judgment--in  the  absence  of 
an  applicable  standard,  your  judgment  may  be  substituted 

(6)  If  a  given  characteristic  meets  its  standard,  record  a  "1"  in 
the  appropriate  cell  of  the  0/1  column.  If  it  does  not  meet 
its  standard  (or  your  judgment),  record  a  "0"  in  this  cell. 

(7)  Record  the  source  of  each  comparison  in  the  appropriate  cell 
of  the  Source  Column.  This  should  be  information  as  to  the 
source  of  the  measurement  itself  and  the  standard.  If  there 
is  insufficient  space  to  record  all  the  required  source  infor 
mation,  append  a  page  and  use  the  space  to  refer  to  it. 

(8)  Multiply  the  0  or  1  for  each  characteristic  by  the  1-100 
rating  of  its  criticality.  Record  the  resulting  products 
in  the  appropriate  cells  of  the  Product  Column. 

(9) .  Add  all  the  products,  and  record  the  resulting  sum  in  the 

Product  Sum  Cell. 
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(10)  Add  all  the  0  or  1  ratings  in  the  Rating  Colunn,  and  record 
the  resulting  sum  in  the  Rating  Sum  Cell. 

(11)  Divide  the  Product  Sun  the  Rating  Sum,  and  multiply  the 
resulting  quotient  by  100.  Record  the  resulting  product  in 
the  Index  Cell.  This  is  the  Index  of  Adequacy  for  this 
measure.  If  the  measures  of  the  significant  characteristics 
just  met  their  standards,  the  Index  would  be  approximately 
100.  The  less  adequate  the  characteristics  that  are  measured, 
considering  their  criticality,  the  farther  below  100  will  be 
the  Index. 


HFE  MEASURE  #1 

UNDERSTANDABILITY  OF  PROCEDURE 


a 


DESCRIPTION:  When  a  task  has  been  performed  inadequately,  one  possible 
cause  is  that  its  procedure  was  too  difficult  for  the  performers.  This 
measure  requires  an  analysis  of  the  performance  of  the  task  being  analyzed 
into  its  component  performance  elements.  These  elements  are  then  used  as 
the  basis  for  a  mul ti-attri bute  rating  process.  Therefore,  to  use  this 
measure,  one  must  either  fully  understand  the  procedure  for  this  task,  or 
have  access  to  an  individual  who  understands  it  and  will  decompose  the 
procedure  into  its  elements  for  you. 


PROCEDURE: 


(1)  On  Worksheet  #1,  list  the  elements  required  to  perform  the 
task  being  analyzed.  These  elements  should  be  analyzed  to 
the  smallest  level  of  detail  possible.  This  analysis  should 
be  made  for  the  specific  system  tested  in  the  OT. 

(2)  On  Worksheet  #1 ,  specify  the  sequence  of  performance  of  the 
listed  elements.  This  is  done  by  recording  sequence  numbers 
in  the  appropriate  Performance  Sequence  Cells  of  the  work¬ 
sheet  (first  element  performed  is  numbered  1,  etc.).  In 
general ,  these  sequence  numbers  should  be  recorded  in  the 
left-hand  column  under  the  heading,  "Performance  Sequence." 
However,  sometimes  an  element  may  be  performed  more  than 
once  during  a  task.  In  this  case,  record  the  second  sequence 
number  for  that  element  in  the  next  colunn,  the  third  nimber 
for  that  element  in  the  third  column,  etc.  If  two  elements 
are  performed  at  the  same  time,  give  them  the  same  sequence 
number. 
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(3)  When  you  have  finished  recording  the  elements  and  their 
sequence  numbers,  add  the  total  number  of  elements.  Record 
the  sun  in  the  box  at  the  bottom  of  the  worksheet. 

(4)  On  Worksheet  #2,  rate  the  task  that  you  have  analyzed. 

Use  all  three  scales,  and  assign  any  rating  from  0-100  to 
each.  Record  the  three  ratings  in  the  appropriate  boxes  of 
this  worksheet.  Two  of  the  three  scales  are  based  on  the 
material  you  developed  in  Worksheet  #1. 

(5)  Compute  the  mean  of  the  three  rating  scales,  and  record  it 
in  the  Mean  Box  at  the  top  of  Worksheet  #2. 


PERFORMANCE 

SEQUENCE 


ELEMENTS  REQUIRED  FOR  TASK  PERFORMANCE 


PROCEDURE  UNDERST ANDA3 I L I  TV 
WORKSHEET  n2 


TASK: 


Assign  a  rating  of  0-100  to  each  of  the  following  attributes  of  under¬ 
standing  of  procedures  for  the  task  listed  above. 


MEAN  RATING 
(INDEX) 


1.  What  is  the  degree  of  similarity  between  the  procedure  for  performing 
this  task  and  the  procedure  for  a  similar  task  that  the  OT  players 
have  actually  performed,  previously?  r - : 


0 _ 25 _ 50 _ 75 _ 100 

Totally  unrelated  Moderately  related  to  100%  identical  to 

to  any  previous  a  previously  performed  previous  procedure, 

procedure.  procedure. 


2.  What  is  the  effect  of  this  task’s  number  of  elements  (shown  on  the 

proceeding  worksheet)  on  the  difficulty  of  understanding  the  procedure 


- - 


0  25 

Number  so  large,  it 
makes  understanding 
impossibly  difficult. 


50 _  75 

Number  of  elements 
produces  moderate 
difficulty  in  under¬ 
standing  procedure. 


100 

This  number  of 
elements  would  not 
increase  the  under¬ 
standing  difficul ty 
at  all. 


3.  What  is  the  effect  of  the  complexity  of  the  sequence  of  performance 
of  the  task  elements  (shown  on  the  preceding  worksheet)  on  the 
difficulty  of  understanding  the  performance?  I - ■ 


0  25  50  75  100 


Sequence  so  complex, 
understanding  of  per¬ 
formance  is  impossible. 


Sequence  complexity 
produces  moderate 
difficulty  in  under¬ 
standing  procedure. 


Sequence  so  simple 
and  1 i near  would  not 
increase  understand- 
i ng  di fficul ty  at  all 


HFE  MEASURE  U2 
DIFFICULTY  OF  DECISIONS 

DESCRIPTION:  One  possible  cause  of  inadequate  task  performance  is  that 
the  required  decisions  were  too  difficult  for  the  performers.  This 
measure  requires  an  analysis  of  the  task  being  analyzed  into  its  decisions 
and  those  decisions  into  their  alternative  responses.  These  decidions  and 
responses  are  then  used  as  a  basis  for  a  mul ti -attribute  ranging  process. 
Therefore,  to  use  this  measure  one  must  either  fully  understand  the  task 
in  the  system  that  was  tested,  or  have  access  to  an  individual  who  does. 

PROCEDURE: 

(1)  On  Worksheet  §1 ,  list  ail  the  decisions  which  must  be  made 
to  perform  this  task  in  this  system.  Then  list  them  on 
Worksheet  #2. 

(2)  On  Worksheet  *1 ,  for  each  listed  decision,  record  the 
realistic  alternative  responses.  These  are  the  actual 
outcomes  among  which  the  individual  making  the  decision 
must  choose. 

(3)  On  Worksheet  #1,  for  each  decision,  add  the  total  number 
of  alternative  responses,  and  record  the  resulting  sums. 

(4)  On  Worksheet  #1 ,  add  the  total  number  of  decisions  required 
for  the  performance  of  the  task,  and  record  the  resulting 
sum  in  the  box  at  the  top  of  the  first  page  of  the  worksheet. 

(5)  On  Worksheet  #2 ,  apply  "Rating  Scales  for  Decision  Difficulty 
Worksheet  § 2 "  to  the  material  you  have  developed  on  Worksheet 
#1 .  The  first  scale  of  the  Rating  Scales  applies  to  all 
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decisions  required  for  the  task  taken  together.  Record  your 
rating  for  this  first  scale  in  the  Rating  for  Scale  One  box 
at  the  top  of  Worksheet  §2.  All  other  rating  scales  apply  to 
each  decision  listed  on  Worksheet  #2.  So,  apply  each  rating 
scale  (from  2-4)  to  each  listed  decision,  and  record  the 
resulting  ratings  in  the  appropriate  cells  of  Worksheet  #2. 

(6)  On  Worksheet  #2,  for  each  decision,  add  the  ratings  of  all 
scales  pi  us  the  rating  of  scale  one  (scale  one  rating  is 
located  in  the  box  at  the  top  of  the  worksheet).  Record 
the  resulting  sums  in  the  appropriate  cells  of  the  left- 
hand  col  inn  of  the  worksheet. 

(7)  Add  all  the  sums  in  the  left-hand  column  of  Worksheet  #2. 
Divide  this  grand  sun  by  the  total  number  of  decisions 
(from  Worksheet  #1)  multiplied  by  six  (the  nunber  of  rating 
scales).  Record  this  mean  rating  in  the  appropriate  box  at 
the  bottom  of  worksheet  #2. 

(8)  For  clarity,  the  rating  scales  of  this  measure  were  designed 
so  that  the  higher  the  rating  the  greater  the  difficulty. 

To  make  the  Index  of  Adequacy  comparable  to 'other  Indices, 
this  direction  must  be  reversed.  Therefore,  the  final  step 
in  this  computation  is  to  subtract  the  product  computed  in 
step  7  from  100.  Record  the  resulting  number  in  the  Index 
Box  on  the  bottom  of  Worksheet  #2.  If  this  Index  of  Adequacy 
is  approximately  100,  decision  difficulty  for  the  task  is 
entirely  adequate.  The  farther  below  100  in  this  Index,  the 
less  adequate  is  decision  difficulty. 


DECISION  DIFFICULTY  RATING 
WORKSHEET  #1 


TASK: _ 

First,  list  all  the  types  of  decisions  that  must  be  made  to  perform  the 
task  above  In  this  system.  Second,  for  each  type  of  decision  listed, 
specify  alternative  responses  among  which  each  decision  selects.  Third, 
record  the  total  number  of  decisions  required  for  this  task  and  the  numb'ei 
of  alternative  responses  for  each  decision.  Fourth,  complete  the  rating 
scales,  on  the  attached  worksheet,  which  apply  to  the  information  you 
have  just  developed.  If  there  is  insufficient  space  on  this  worksheet, 
photocopy  it. 

TOTAL  NUMBER  OF  DECISIONS  REQUIRED  FOR  TASK  I I 


DECISIONS  REQUIRED  FOR  TASK 


ALTERNATIVE  RESPONSES  TO  EACH  DECISION 


DECISION  DIFFICULTY  RATING 
WORKSHEET  #1  (CONTINUED) 

DECISIONS  REQUIRED  FOR  TASK  ALTERNATIVE  RESPONSES  TO  EACH  DECISION 


DECISION  DIFFICULTY  RATING 
WORKSHEET  #1  (CONTINUED) 


RATING  SCALES  FOR  DECISION 
DIFFICULTY  WORKSHEET  #2 


'Rating  scale  number  one  applies  to  all  decisions  required  for  this  task, 
taken  together.  All  other  rating  scales  apply  to  each  required  decision, 
independently.  Record  your  rating  from  the  rating  scale  number  one  in 
the  box  at  the  top  of  Worksheet  ¥2,  and  all  other  ratings  in  the  appro-.' 
priate  cells  of  the  worksheet. 

1 .  How  difficult  wou Id  it  be  to  make  the  number  of  dec  I s Ions  requi red 
for  the  performance  of  this  task  in  this  system? 

0 _ 25 _ 50 _ 75 _ 100 

No  difficulty  Moderately  So  difficult 

at  all.  difficult.  that  it  could 

not  be  done. 


2.  How  s ign i f icant  would  this  decision  be  when  made  as  part  of  the  bask 
in  this  system? 


25 


50 


75 


100 


No  significance 
at  all. 


Moderate  I y 
sign  I f icant. 


Extremely  signi¬ 
ficant.  Affects 
mission  success, 
system  surviva¬ 
bility. 


3.  Under  real istic  conditions,  how  much  t i me  will  be  I  ike  I y  to  be 
available  to  make  this  decision  and  still  permit  the  taskto  be 
performed  successfully? 


0 _ 25 

Time  is  not  an  issue 
at  all.  Any  amount 
can  be  taken. 


_ 50 _ 

Moderate  amount  of 
time  can  be  taken 
and  the  taskcan  be 
performed  successfully. 


75 _ 100 

Only  a  very 
sma I  I  amount  of 
time  can  be  takea 


RATING  SCALES 
WORKSHEET  #2  (CONTINUED) 


4.  To  what  extent  is  this  decision  i rrevers i b I e  If  made  during  the 
performance  of  this  HPF  in  this  system? 


0 

25 

50 

75 

100 

Not  an  issue. 

Sma 1 !  number  of 

1 rrevers i b i 1 i ty 

Decision  may  be 

reversals  possible. 

tota 1  . 

Dec i s  ion 

reversed  as  many 

must  stand  as  made. 

times  as  desi red. 

5.  How  difficult  would  it  be 

to  make  this  decision 

considering  ■ 

the 

number  of  alternative  responses  possible? 

0 

25 

50 

75 

100 

No  difficulty 

Moderately 

So  difficult  that 

at  all. 

difficult. 

th  i  s  i 

dec  is  ion 

cou  1  d 

not  be  made 

successful ly. 

6 .  How  similar  are 

the  alternative  responses  which 

must  be  considered 

in  maki ng  this 

dec i sion? 

0 

25 

50 

75 

100 

No  similarity  at 
all.  Responses 
are  comp  I ete I y 
different  from 
each  other. 


Moderate  I y 
simi I ar. 


Responses  are 
extreme  I  y  s  imi  I  ar. 
Hard  to  separate. 


V 


I 


HFE  MEASURE  #3 

ADEQUACY  AND  TIMELINESS  OF  DISPLAY  INFORMATION 


DESCRIPTION:  One  possible  cause  of  inadequate  task  performance  is  that 
required  information  was  not  available  in  time  for  its  use.  This  measure 
requires  the  identification  of  the  information  required  for  the  perform¬ 
ance  of  the  task  being  diagnosed.  In  addition,  it  requires  the  judgment  1 
of  whether  each  piece  of  required  information  is  time  sensitive.  If  a 
piece  of  information  is  so  judged,  it  then  requires  the  judgment  of  the 
maximum  length  of  time  that  can  occur  before  the  useful  appearance  of 
that  information.  Therefore,  to  use  this  measure,  one  must  thoroughly 
understand  the  information  requirements  for  the  task,  have  access  to 
detailed  documentation  about  these  requirements,  or  have  access  to  an 
individual  who  thoroughly  understands  these  requirements. 

PROCEDURE: 

(1)  Record  all  the  information  which  is  absolutely  required  for 
the  successful  performance  of  the  task  being  diagnosed. 

This  includes  information  that  would  be  produced  visually 
or  auditorily.  It  does  not  apply  to  one  display  only.  It 
applies  to  all  the  displays  that  produce  such  required 
information. 

(2)  Next,  determine  if  each  piece  of  listed  information  is  time 
sensitive  and  if  the  display  that  produces  that  information 
could  be  a  significant  factor  when  the  information  was 
presented.  For  example,  target  range  may  be  a  piece  of 
information  that  is  absolutely  required.  Further,  it  is 
likely  to  be  time  sensitive.  However,  if  it  is  produced  by 
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a  radio,  the  radio  cannot  affect  presentation  time  (except 
by  malfunctioning).  In  this  case,  target  range  produced  by 
radio  would  not  meet  the  time  sensitivity  criteria. 


(3)  For  each  recorded  information  requirement  that  meets  both  of 
these  criteria,  record  an  "X"  in  the  appropriate  cell  of  the 
X  Colimn. 

(4)  For  each  information  requirement  with  an  adjacent  UX" 
estimate  the  maximum  length  of  time  permissible  between  some 
fixed  point  in  time  and  the  appearance  of  that  information. 
Frequently,  the  fixed  point  in  time  will  be  the  start  of  the 
task.  However,  it  really  depends  upon  the  data  available. 

(5)  Record  each  permissible  time  in  the  appropriate  cell  of  the 
Time  Column.  It  may  be  impossible  to  make  certain  time 
estimates.  If  this  cannot  be  done,  replace  its  "X"  with  an 

(6)  Compare  the  information  requirements  listed  on  the  worksheet 
with  the  information  actually  produced  by  the  display(s)  used 
in  task  performance.  This  may  be  done  with  the  actual  physi¬ 
cal  equipment,  or  detailed  specifications  of  that  equipment. 

(7)  If  a  given  piece  of  required  information  is  actually  produced, 
record  a  "1"  in  the  appropriate  cell  of  the  1/0  column.  If  it 
is  not  produced,  record  a  "0". 

(8)  For  each  piece  of  information  that  has  both  a  "1"  (from  step 
7)  and  an  "X"  (meaning  it  is  time  sensitive),  determine  the 
length  of  time  between  the  fixed  start  time  (see  step  4)  and 
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the  appearance  of  that  i nformation.  If  you  are  unable  to 
obtain  this  time  data,  record  an  asterisk  ("*")  in  the 
appropriate  cell  of  the  I/O  TIME  Column. 

(9)  If  a  piece  of  required  information  appears  on  or  before  the 
listed  time  limit,  record  a  "1"  in  the  appropriate  cell  of 
the  1/0  TIME  Column.  If  it  does  not,  record  a  "0". 

(10)  For  each  listed  piece  of  required  information,  multiply  the 

contents  of  its  1/0  and  1/0  TIME  Cells.  An  1/0  Cell  can 
contain  a  ”0"  or  a  "1".  An  I/O  TIME  Cell  can  contain  a  "0", 
a  "1",  an  asterisk  or  nothing.  Clearly,  you  only 

multiply  zeroes  and  ones.  For  each  piece  of  information, 
record  the  product  of  multiplying  the  zeroes  and  ones  in  the 
appropriate  cell  of  the  PRDCT  Column.  If  an  1/0  TIME  Cell 
has  an  asterisk  or  nothing  as  its  content,  record  the  content 
of  the  parallel  1/0  Cell  in  the  PRDCT  Column. 

(11)  Add  the  contents  of  the  PRDCT  Colunn,  and  record  the  resulting 
sum  in  the  Sum  box  at  the  bottom  of  the  worksheet. 

(12)  Count  the  number  of  pieces  of  required  information  for  the 
task.  Divide  the  number  in  the  Sum  box  (from  step  1)  by  the 
total  number  of  pieces  of  required  information.  Record  the 
resulting  quotient  at  the  bottom  of  the  worksheet. 

(13)  Multiply  the  quotient  by  100,  and  record  the  resulting  product 
in  the  Index  box  at  the  bottom  of  the  worksheet.  This  is  the 
Index  of  Adequacy  of  this  measure.  If  it  is  approximately  100, 
all  required  information  is  present  and  has  been  presented 
soon  enough  to  be  useful.  The  further  below  100  this  Index, 
the  less  adequate  and  timely  the  information  presented. 


HFE  MEASURE 

DISPLAY  READABI LITY/ HEARABI LITY 


DESCRIPTION:  HFE  Measure  #4  (Adequacy  and  Timeliness  of  Display  Informa¬ 
tion)  results  in  a  list  of  pieces  of  information  that  are  both  absolutely 
required  for  task  performance  and  presented  by  system  display(s)  in  time 
to  be  used.  Other  information  that  is  not  absolutely  required  and  that 
is  also  presented  by  displays  may  have  some  utility  for  task  performance. 
However,  such  information  is,  by  definition,  not  required  for  this  perfor¬ 
mance.  Therefore,  the  only  significant  reason  for  studying  this  non- 
required  information  is  to  determine  the  "clutter"  and  overload  produced 
by  the  display(s). 

Even  if  required  information  is  presented  (and  presented  in  time  for  use), 
the  nature  of  its  presentation  may  vary  in  adequacy.  If  such  information 
is  presented,  but  in  an  entirely  inadequate  matter,  it  may  be  unusable. 

The  nature  of  presentation  is,  therefore,  a  possible  cause  of  inadequate 
task  performance. 

This  measure  is  based  on  the  list  of  information  developed  in  HFE  Measure 
#3.  It  includes  three  worksheets.  Worksheet  #1  provides  a  format  for 
assigning  required  pieces  of  information  (from  HFE  Measure  # 3)  to  their 
originating  displays.  This  is  necessary  since  these  pieces  of  informa¬ 
tion  are  measured  independent  of  their  displays  in  Measure  #3.  Worksheet 
§ 2  provides  the  format  for  measuring  visual  displays.  Worksheet  #3 
provides  the  format  for  measuring  auditory  displays.  In  both  Worksheets 
#2  and  #2,  the  formats  of  required  information  provided  by  a  singledisplay 
are  rated,  measured,  and  compared  to  standards. 
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PROCEDURE: 

(1)  On  Worksheet  #1  list  all  the  visual  and  auditory  displays 
that  produce  required  information  for  the  task  being  analyzed. 
Also  record  the  required  information.  This  information  should 
be  available  from  the  completed  Measure  #3. 

(2)  Record  "X‘s"  in  the  appropriate  cells  of  Worksheet  #1  to 
indicate  the  display(s)  that  produce  each  piece  of  required 
information.  The  remainder  of  this  procedure  applies  to  any 
single  task  being  diagnosed. 

(3)  Examine  your  completed  Worksheet  #1 ,  and  determine  how  many 
visual  displays  are  listed.  Make  as  many  copies  of  Worksheet 
#2  as  you  need  for  measuring  visual  displays  (one  worksheet 
per  display).  Do  the  same  for  auditory  displays  (copying 
Worksheet  #3). 

(4)  Fill  in  the  background  information  on  each  Worksheet. 

(5)  For  each  Worksheet  ?2  and  #2,  apply  the  "Common  Procedures  for 
Measures  9  through  14." 

(6)  If  more  than  one  display  were  rated  in  this  Measure,  compute 
the  mean  of  the  various  Indices  of  Adequacy  which  resulted, 
and  record  this  Mean  Index  in  the  appropriate  box  of  Worksheet 
#1. 
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DISPLAY  READABILITY/HEARABILITY 
WORKSHEET  #2  (VISUAL) 


TASK: _ 

CONDITIONS  (if  applicable): _ 

IF  MORE  THAN  ONE  DISPLAY  IS  USED 
FOR  THIS  TASK  RECORD  MEAN  INDEX 
OF  ALL  DISPLAYS  IN  BOX  WHiCH 
FOLLOWS  (COMPUTED  FROM  WORKSHEETS 


Q. 

c/) 


>  Tffcji 


D I  SPLAY  READABI L I TY/UNDERSTANDAB I  LI TY 
WORKSHEET  #2  (AUDITORY) 


DISPLAY: 

TASK: 


CONDITIONS: 


CHARACTERISTICS 


p 

VOLUME 

FREQUENCY  RANGE 

mm 

DYNAMIC  RANGE 

7 

SIGNAL  TO  NOISE 

■" 

RATIO 

r. 

r. 

<*. 

HARMONIC  DISTORTION 

CLIPPING 


OISCRIMINABILITY 


ALERTING  CAPABILITY 


MASKING 


SPURIOUS  SIGNALS 


DISPLAY  READABI LI T  Y /HE ARAB  I LI TY 
WORKSHEET  //5  (AUDITORY) 


HFE  MEASURE  #5 

DISPLAY  INFORMATION  UNDERSTANDAB I  LI TY 


DESCRIPTION:  The  purpose  of  this  measure  is  to  determine  the  adequacy 
of  a  display(s)  presentation  that  leads  to  the  understanding  of  informa¬ 
tion.  This  is  in  some  contrast  to  HFE  Measure  #4  that  deals  with  display 
presentation  that  leads  to  perception  of  required  information.  Apart 
from  this  distinction,  this  HFE  Measure  is  basically  quite  similar  to 
Measure  #4.  It  can  be  used  without  direct  reference  to  the  specific 
pieces  of  information  that  are  required  for  task  performance.  However, 
it  should  result  in  more  valid  and  reliable  findings  if  it  is  based  on  a 
completed  "Display  Visibility/Hearability  Worksheet  #1"  from  HFE  Measure 
#4.  In  this  measure,  you  rate  display  understandabi 1 i ty  on  a  multi-attri¬ 
bute  scale,  specific  to  each  task  being  analyzed. 

PROCEDURE: 

(1)  If  you  have  completed  HFE  Measure  #4,  retrieve  the  filled 
in  "Display  Visibility/Hearability  Worksheet  #1." 

(2)  Record  the  names  of  the  appropriate  displays,  used  in  task 
performance. 

(3)  Rate  the  understandabi 1 i ty  of  the  presentation  of  the 
required  information  for  each  display  on  the  six  scales 
found  in  "Rating  Scales  for  Display  Information  Understand¬ 
abi  1  ity  Worksheet. " 

(4)  Add  all  ratings  for  each  display,  and  record  the  resulting 
sums  in  the  appropriate  cells  of  the  Sum  colunn. 


(5)  Divide  each  sum  (from  Step  6)  by  four--the  number  of  scales 
used.  Record  the  resulting  quotients  in  the  appropriate 
cells  of  the  Sum/6  Column.  These  are  the  Indices  of  Adequacy 
for  each  display  used  in  the  task.  If  a  given  display  was 
completely  inadequate,  its  Index  should  be  approximately 
100.  The  less  adequate  the  display,  the  further  below  100 
will  be  the  Index. 

(6)  If  a  task  used  only  one  display,  the  measure  will  now  be 
complete.  If  the  task  used  more  than  one  display,  compute 
the  mean  of  the  Indices  (from  Step  5).  Record  this  Mean 
Index  in  the  appropriate  box  at  the  bottom  of  the  worksheet. 


RATING  SCALES  FOR  DISPLAY  INFORMATION 
UNDERSTANDABI Li TY  WORKSHEET 


1.  How  adequate  is  the  I  eve  I  of  simplicity  (as  opposed  to  complexity) 
of  the  vocabulary  and/or  symbols  used  by  this  display  to  impart 


Information  for 

th I s  task? 

COMPLETELY 

COMPLETELY 

INADEQUATE 

ADEQUATE 

0 

25  50 

75 

100 

So 

comp  1  ex  they 

May  cause 

Should  cause  ' 

wl  1 

1 1  be  Imposs 1 b 1 e 

some  problems. 

no  d  1  ff  icu  1  ty.. 

to 

understand . 

2. 

How  fami 1 iar  is 

the  vocabulary  and/or  symbology 

used 

in  this  display 

for  this  task  likely  to  be  to  the  user  population? 


COMPLETELY 

UNFAMILIAR 

0 

25 

50 

75 

COMPLETELY 

FAMILIAR 

100 

No  transfer  of 

Some  transfer 

Suff  icient  trans¬ 

training 

poss I b 1 e. 

fer  of  training 

possible. 

should  take  place. 

3.  To  what  extent  are  the  symbo I s/vocabu I  ary  used  in  the  display  for  the 
task  similar  to  other  symbo I s/vocabu I  ary  that  have  a  different  meaning? 


completely  COMPLETELY 

CONFUSING  CLEAR 

0  25  50  75  100 


Identical  to  other 
symbo I s/vocabu I  ary , 
but  with  a  radically 
different  meaning. 


Moderate  confusion 
between  this  symbology/ 
vocabulary  and  meaning 
of  similar  one. 


Symbol s/vocabu- 
lary  either 
adequate  I y 
different  from 
other,  or  with 
adequately 
s imi lar  mean ing. 


RATING  SCALES  (CONTINUED) 


.4.  How  adequate  is  the  total  amount  of  information  presented,  at  any 

given  time  by  this  display,  for  the  understanding  of  that  information 
for  th i s  task? 


COMPLETELY 

INADEQUATE 

0 

25 

50 

75 

COMPLETELY 

ADEQUATE 

100 

So  much  infor¬ 
mation  presented 
at  once  that  it 
cannot  be  understood, 
or  so  little  that 

TFe  key  relationships 
are  lost. 

Moderately  understanab le 
amount  of  information 
presented  at  one  time. 

Understandab  1  e 
.  amount  of  Infor¬ 
mation  presented 
at  one  time  for 
understand  I ng . 

5.  How  adequate  is  the  amount  of  time  in  which  required 

Information  Is 

presented  by  this 

d  I  sp 

lay  for  this  task, for  the 

understanding  of  that 

information? 

COMPLETELY 

INADEQUATE 

0 

25 

50 

75 

COMPLETELY 

ADEQUATE 

100 

Presentation  time 
total ly  much  too 
short . 

Presentation  time  a 

1 ittle  too  short. 

Adequate  amount 
of  presentation 
time. 

6.  How  adequate  was  the  rate  of  presentation  of  Informat 

ion  by  this 

display,  for  th 1 s 

task 

.for  the  understanding  of 

that 

information? 

COMPLETELY 

1  NAD EQUATE 

0 

25 

50 

75 

COMPLETELY 

ADEQUATE 

100 

Presentation  rate 
much  to  rapid. 

Moderately  Inadequate 
presentation  rate. 

Presentation  rate 
completely 

adequate. 


DISPLAY  INFORMATION 
UNDERSTANDABI LI TY  WORKSHEET 


HFE  MEASURE  ti 6 
CONTROL  ACCESSIBILITY 


DESCRIPTION:  If  the  performance  of  a  task  requires  the  manipulation  of  a 
control  (or  some  other  piece  of  equipment),  the  adequacy  of  its  accessi¬ 
bility  may  affect  that  performance.  The  harder  it  is  to  access  a  piece 
of  equipment  that  must  be  manipulated,  the  greater  the  likelihood  that 
the  manipulation  may  be  ineffective.  The  first  problem  in  the  measure 
is  to  identify  those  controls  and  other  pieces  of  equipment  that  must  be 
manipulated  for  the  adequate  performance  of  the  task  being  analyzed.  The' 
second  problem  is  to  determine  whether  each  control ,  or  other  piece  of 
manipulated  equipment,  is  adequately  accessible  to  its  user.  Therefore, 
to  take  this  measure  you  must  have  access  to  the  actual  hardware,  de¬ 
tailed  specifications  of  that  hardware,  or  similar  HFE  test  results  from 
an  earlier  test. 

PROCEDURE: 

(1)  "Accessibility  Adequacy  on  the  Worksheet,"  list  all  the 
controls  and  other  equipment  that  must  be  manipulated  for 
adequate  performance  of  the  task  being  analyzed.  They 
should  be  listed  at  the  most  detailed  level  possible  (for 
example,  remove  screws  A  and  B,  and  then  remove  component 
C). 

(2)  If  possible,  after  listing  the  control /equipment  list  the 
title  of  the  crew  member  who  is  supposed  to  perform  the 
manipulation  and  the  hand  or  foot  with  which  the  manipulation 
should  be  done. 

(3)  Either  take  appropriate  accessibility  measurements  for  each 
control /equi pment  listed,  or  take  measurements  from  detailed 
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specifications  or  previous  tests.  In  this  measure,  accessi¬ 
bility  is  determined  by: 

(a)  Reach  distance; 

(b)  Diameter/ci rcumference  of  restricted  reach  envelope; 

(c)  Reach  angle  to  work  location  of  appropriate  Individual; 

(d)  Absence  or  presence  of  potentially  obscuring  object(s) 
or  people. 

(4)  Compare  each  measure  with  its  appropriate  standard  (from 
MIL-STD-1472 ,  HEDGE,  H FT EM AN »  etc.).  In  the  absence  of 
such  objective  standards,  you  may  substitute  your  expert 
judgnent,  though  this  is  substantially  less  desirable. 

(5)  If  a  given  control /equipment  meets  all  accessibi 1 i ty 
standards  (or  your  judgment)  record  a  "1"  in  the  appropriate 
cell  of  the  0/1  column  on  the  worksheet.  If  it  does  not 
meet  all  such  standards,  record  a  ”0". 

(6)  Record  the  source  of  your  standard  and  measurement  in  the 
appropriate  cell  of  the  Source  colunn.  If  there  is  insuffi¬ 
cient  space  in  a  cell,  record  the  source  information  on  an 
appended  sheet,  and  reference  it  in  the  cell. 

(7)  If  a  given  control /equipment  is  given  a  "Q”,  it  is  suggested 
that  you  append  a  sheet,  and  describe  the  nature  of  the 
accessibility  problem  in  some  detail  on  this  sheet. 

(8)  Add  the  contents  of  the  cells  of  the  0/1  column,  and  record 
the  resulting  sum  in  the  Sum  box. 
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(9)  Count  the  number  of  controls  and  pieces  of  equipment  to  be 
manipulated  for  the  task.  Record  this  number  in  the 
#  Controls/Equipment  box. 

(10)  Divide  the  sum  by  the  number  of  controls/equipment,  and 

multiply  the  resulting  quotient  by  100.  Record  this  product 
in  the  Index  box.  This  is  the  Index  of  Adequacy  of  Accessi¬ 
bility.  If  all  controls  and  other  equipment  to  be  manipula¬ 
ted  are  fully  accessible,  this  Index  will  be  approximately  , 
100.  The  less  adequate  their  accessibility,  the  further 
below  100  will  be  the  Index. 


ACCESSIBILITY  ADEQUACY  WORKSHEET 


TASK: 

CONDITIONS: 


CONTROLS/EQUIPMENT;  JOB  TITLE;  HAND/FOOT  0/1  SOURCE 


#  CONTROLS/EQUIP 


SUM 


INDEX 
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HFE  MEASURE  #7 

CONTROL  STATIC  CHARACTERISTICS 


DESCRIPTION:  In  HERTES  static  characteristics,  dynamic  characteristics, 
and  accessibility  have  been  separated  into  categories  of  measures  of 
control  and  other  equipment  to  be  manipulated.  Static  characteristics 
are  those  that  affect:  location,  identification,  and  individual  activa¬ 
tion  of  controls  or  other  equipment  to  be  manipulated  in  the  performance 
of  a  task  that  is  being  analyzed.  When  a  task  has  been  performed  inade-  • 
quately,  one  possible  cause  is  that  the  control (s)  or  other  equipment 
which  had  to  be  manipulated  could  not  be:  identified  in  time  by  touch  or 
vision;  or  activated  independently  of  adjacent  controls.  This  measure 
uses  the  "Accessibility  Worksheet"  from  HFE  Measure  #6.  On  this  previous 
worksheet  you  identified  those  controls  and  other  equipment  to  be  manipu¬ 
lated  for  the  task.  These  same  controls/equipment  will  now  have  their 
static  characteristics  measured  and  compared  to  objective  or  subjective 
standards.  The  steps  of  this  measure  are  largely  identical  to  those 
described  in  Common  Procedures. 

PROCEDURE: 

(1)  Retrieve  your  completed  copy  of  "Accessibility  Adequacy 
Worksheet"  from  HFE  Measure  # 6,  and  copy  the  controls  and 
other  equipment  to  be  manipulated.  If  Measure  #6  has  not 
been  completed,  you  will  have  to  develop  this  list  now.  It 
consists  of  those  controls  and  other  pieces  of  equipment  to 
be  manipulated  in  the  performance  of  the  task  that  are 
absolutely  necessary. 

(2)  Study  the  characteristics  listed  on  the  worksheet.  If  you 
think  that  a  significant  characteristic  is  missing,  add  it 
in  the  "Other"  category. 
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(3)  For  each  control /equi pment  listed  decide  if  each  character¬ 
istic  on  the  worksheet  is  relevant  to  the  performance  of 
the  task  being  diagnosed  in  this  system.  If  it  might  have 

a  significant  effect  on  the  task  performance  In  this  system, 
it  is  relevant.  In  this  case  record  an  "Xu  in  the  appropri¬ 
ate  cell  of  the  Relevance  row.  If  a  characteristic  is  not 
relevant,  record  a  "0“  in  the  cell. 

(4)  Rate  each  characteristic  that  you  have  selected  for  each 
control/equipment  on  the  criticality  scale  which  follows. 

Select  any  rating  from  1-100.  Record  the  ratings  in  the 
appropriate  cells  of  the  Rating  row. 

LOW  CRITICALITY  MODERATE  CRITICALITY  HIGH  CRITICALITY 

1 _ _25 _ 50 _ 75 _ 100 

Just  important  enough  Criticality  moderate  Criticality  extreme- 

to  be  measured.  Criti-  for  this  task.  ly  high  for  this 

cality  low  for  this  task.  task. 

(5)  Obtain  appropriate  measurements  of  each  characteristic  you 
have  selected.  This  may  be  done  in  the  following  ways: 

(a)  Obtaining  appropriate  measurements  from  previous  OT's 
DT's,  HFE  tests,  or  other  reasonably  reliable  sources; 

(b)  Physically  taking  the  necessary  measurements  from  the 
actual  system; 

(c)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 

(6)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 
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(a)  Comparison  with  reasonably  valid  specifications  such 
as  those  found  in  MIL  STD-1472,  HEDGE,  and  HFTEMAN-- 
this  is,  of  course,  preferable; 

(b)  Evaluation  based  on  expert  jedgment--in  the  absence  of 
an  applicable  standard  your  judgment  may  be  substituted. 

(7)  If  a  given  characteristic  meets  its  standard,  record  a  "1" 
in  the  appropriate  cell  of  the  0/1  row.  If  it  does  not 
meet  its  standard  (or  your  judgment),  record  a  "O'*  in  this 
cell. 

(8)  Record  the  source  of  each  comparison  in  the  appropriate  ceil 
of  the  Source  row.  This  should  be  information  as  to  the 
source  of  the  measurement  itself  and  the  standard.  If  there 
is  insufficient  space  to  record  all  the  required  source 
information,  append  a  page  and  use  the  space  to  refer  to  it. 

(9)  Multiply  the  0  or  1  for  each  characteristic  by  the  1-100 
rating  of  its  criticality.  Record  the  resulting  products  in 
the  appropriate  cells  of  the  Product  row. 

(10)  Add  all  the  products,  and  record  the  resulting  sum  ;n  the 
Product  Sum  Cells. 

(11)  Add  all  the  0  or  1  ratings  in  the  Rating  column,  and  record 
the  resulting  sun  in  the  Rating  Sum  Cells. 

(12)  Divide  each  Product  Sum  b^  its  Rating  Sun,  and  multiply  the 
resulting  quotient  by  100.  Record  the  resulting  products  in 
the  Control  Index  Cells.  These  are  the  Indices  of  Adequacy 
for  this  measure  of  controls/equipment.  If  the  measures  of 


the  significant  characteristics  just  met  their  standards,  a 
given  Index  would  be  approximately  100.  The  less  adequate 
the  characteristics  that  are  measured,  considering  their 
criticality,  the  further  below  100  will  be  the  Index. 

(13)  Compute  the  mean  of  the  Control  Indices.  Record  it  in  the 
Mean  Index  box  of  the  worksheet.  This  Is  the  Index  of 
Adequacy  static  characteristics  of  all  controls  and  equip¬ 
ment  to  be  manipulated  in  the  performance  of  the  task  being 
analyzed. 
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HFE  MEASURE  #8 

CONTROL  DYNAMIC  CHARACTERISTICS 


DESCRIPTION:  In  HRTES  static  characteristics,  dynamic  characteristics, 
and  accessibility  have  been  separated  into  categories  of  measures  of 
controls  and  other  equipment  to  be  manipulated.  Dynamic  characteristics 
are  those  that  affect  control  movement  and  sensing  of  that  movement.  This 
measure  uses  either  the  "Accessibility  Adequacy  Worksheet"  from  HFE 
Measure  #6,  or  the  "Static  Characteristics  Worksheet"  from  HFE  Measure  #7. 
On  these  previous  Worksheets  you  identified  those  controls  and  other 
equipment  to  be  manipulated  for  the  task.  These  same  controls/equipment 
will  now  have  their  dynamic  characteristics  measured  and  compared  to 
objective  or  subjective  standards.  The  steps  of  this  measure  are  identi¬ 
cal  to  those  in  HFE  Measure  #7  and  similar  to  those  described  in  Conmon 
Procedures. 

PROCEDURE: 

(1)  Retrieve  your  completed  copy  of  "Accessibility  Adequacy 
Worksheet"  from  HFE  Measure  #6,  or  "Static  Characteristics 
Worksheet"  from  HFE  Measure  #7.  Copy  the  controls  and 
other  equipment  to  be  manipulated.  If  Measures  #6  or  #7 
have  not  been  completed,  you  will  have  to  develop  this  list 
now.  It  consists  of  those  controls  and  other  pieces  of 
equipment  to  be  manipulated  in  the  performance  of  the  task 
that  are  absolutely  necessary. 

(2)  Study  the  characteristics  listed  on  the  Worksheet.  If  you 
think  that  a  significant  characteristic  is  missing,  add  it 
in  the  "Other"  category. 


(3)  For  each  control /equipment  listed  decide  if  each  characteristic 
on  the  Worksheet  is  relevant  to  the  performance  of  the  task 
being  analyzed  in  this  system.  If  it  might  have  a  significant 
effect  on  task  performance  in  this  system,  it  is  relevant.  In 
this  case  record  an  "X"  in  the  appropriate  cell  of  the 
Relevance  Row.  If  a  characteristic  is  not  relevant,  record  a 
"0"  in  the  cell. 

(4)  Rate  each  characteristic  that  you  have  selected  for  each 
control /equipment  on  the  criticality  scale  which  follows. 

Select  any  rating  from  1-100.  Record  the  ratings  in  the 
appropriate  cells  of  the  Rating  Row. 


LOW  CRITICALITY 

1 _ 25_ 

Just  important  enough 
to  be  measured.  Criti¬ 
cality  low  for  this  task. 


MODERATE  CRITICALITY 
_ 50 _ 

Criticality  moderate 
for  this  task. 


HIGH  CRITICALITY 
_ 100 

Criticality  ex¬ 
tremely  high  for 
this  task. 


(5)  Obtain  appropriate  measurements  of  each  characteristic  you 
have  selected.  This  may  be  done  in  the  following  ways: 

(a)  Obtaining  appropriate  measurements  from  previous  OT’s 
OT's,  HFE  tests,  or  other  reasonably  reliable  sources. 

(b)  Physically  taking  the  necessary  measurements  from  the 
actual  system. 

(c)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 

(6)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 
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(a)  Comparison  with  reasonably  valid  specifications  such 
as  those  found  in  MIL  STD-1472,  HEDGE,  and  HFTEMAN-- 
this  is,  of  course,  preferable. 

(b)  Evaluation  based  on  expert  judgment--in  the  absence  of 
an  applicable  standard  your  judgment  may  be  substituted. 

(7)  If  a  given  characteristic  meets  its  standard,  record  a  “l" 
in  the  appropriate  cell  of  the  0/1  Row.  If  it  does  not  meet 
its  standard  (or  your  judgment),  record  a  "0"  in  its  cell. 

(8)  Record  the  source  of  each  comparison  in  the  appropriate  cell 
of  the  Source  Row.  This  should  be  information  as  to  the 
source  of  the  measurement  itself  and  the  standard.  If  there 
is  insufficient  space  to  record  all  the  required  source  infor¬ 
mation,  append  a  page  and  use  the  space  to  refer  to  it. 

(9)  Multiply  the  0  or  1  for  each  characteristic  by  the  1-100 
rating  of  its  criticality.  Record  the  resulting  products 
in  the  appropriate  cells  of  the  Product  Row. 

(10)  Add  all  the  products,  and  record  the  resulting  sum  in  the 
Product  Sum  Cells. 

(11)  Add  all  the  0  or  1  ratings  in  the  Rating  Column,  and  record 
the  resulting  sum  in  the  Rating  Sum  Cells. 

(12)  Divide  each  Product  Sum  b^  its  Rating  Sum,  and  multiply  the 
resulting  quotient  by  100.  Record  the  resulting  products 
in  the  Control  Index  Cells.  These  are  the  Indices  of 
Adequacy  for  this  measur  of  controls/equipment.  If  the 
measures  of  the  significant  characteristics  just  met  their 
standards,  a  giver  Index  would  be  approximately  100.  The 
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less  adequate  the  characteristics  that  are  measured, 
considering  their  criticality,  the  further  below  100  will 
be  the  Index. 

(13)  Compute  the  mean  of  the  control  Indices.  Record  it  in  the 
Mean  Index  Box  of  the  Worksheet.  This  is  the  Index  of 
Adequacy  of  Dynamic  Characteristics  of  all  controls  and 
equipment  to  be  manipulated  in  the  performance  of  the  task 
being  analyzed. 
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DYNAMIC  CHARACTERISTICS  WORKSHEET 


TASK: _ 

COfOITlONS  (If  tppl Icabla) : 


f 


CONTROLS  AND  ODO  EQUIPMENT  TO 
BE  MANIPULATED  FOR  HARDWARE 


s 


« 

a 

5  a 

is' 


*3 


MF 


57T 

pWct 


TTlTOhcT 

PHHT" 


o/i 


m. mssL 


SOS. 


QZJL_ 

PfiOCT 


It 

RATING 


RELEVANCE 


WM 


relevance 

KTTO — 


QAL 


PROCT 


RELEVANCE 


Mima 


p^fer 


ftfiiVANce 

RATING 


MEAN 
I  NO  EX 


_» >t#L  |jjj 


HFE  MEASURE  #9  -  WORKSTATION  DIMENSIONAL 
CHARACTERISTICS  ADEQUACY  WORKSHEET 


TAS-K: 


CONDITIONS  (IT  applicant): 


CHARACTERISTICS 


WORK  SURFACE  DEPTH 


SOURCE 


HFE  MEASURE  #11  -  WORKSTATION  ENVIRONMENT 
VISUAL  CHARACTERISTICS  ADEQUACY  WORKSHEET 


TASK: 


CONDITIONS  (If  applicable): 


LU 

O 

|  g 

VISUAL  5  P 

CHARACTERISTICS  2  5 


EXTERNAL  ILLUMINATION 


EXTERNAL  WARNING  ILLUMINATION 


'WORKSTATION  AMBIENT  ILLUMINATION 


WORKSTATION  DIRECT  ILLUMINATION 


EXTERNAL  FiaD  OF  VIEW 


VIEWING  ANGLE  TO  TARGET ( S ) 


VIEWING  ANGLE  TO  SIGNIFICANT  PARTS 
OF  WORKSTATION  (OTHER  THAN  DISPLAYS) 

VISUAL  DISTORTION  FROM  WORKSTATION 


VISUAL  OBSCURATION  FROM  WORKSTATION 


VISUAL  OBSCURATION  WITHIN  WORKSTATION 


REFLECTIVITY  WITHIN  WORKSTATION 


VISIBILITY  OF  WORKSTATION  EXTERIOR 


OTHER: 


RATING 

SUM 


PRDCT 

SUM 


SOURCE 


INDEX 


HFE  MEASURE  #12  -  WORKSTATION  ENVIRONMENT 
SOUND  CHARACTERISTICS  ADEQUACY  WORKSHEET 


TASK; _ 

CONDITIONS  (If  applicable): 


SOUND 

CHARACTERISTICS 


SOUND  FREQUENCY  WITHIN  WORKSTATION 
SOUND  AMPLITUDE  WITHIN  WORKSTATION 


SOUNO  FREQUENCY  OUTSIDE  WORKSTATION 
SOUND  AMPLITUDE  OUTSIDE  WORKSTATION 
OTHER: 


(9)  Count  the  number  of  controls  and  pieces  of  equipment  to  be 
manipulated  for  the  task.  Record  this  number  in  the 
#  Controls/Equipment  box. 

(10)  Divide  the  sum  by  the  number  of  controls/equipment,,  and 

multiply  the  resulting  quotient  by  100.  Record  this  product 
in  the  Index  box.  This  is  the  Index  of  Adequacy  of  Accessi¬ 
bility.  If  all  controls  and  other  equipment  to  be  manipula¬ 
ted  are  fully  accessible,  this  Index  will  be  approximately 
100.  The  less  adequate  their  accessibility,  the  further 
below  100  will  be  the  Index. 
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HFE  MEASURE  #14  -  WORKSTATION/ENVIRONMENT 
VENTILATION  CHARACTERISTICS  ADEQUACY  WORKSHEET 


TASKj _ 

CONDITIONS  (If  applicable): 


Ui 


SUM 
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HFE  MEASURE  #15  -  WORKSTATION 
HAZARD  CHARACTERISTICS  WORKSHEET 


TA^K: 


OWOITIOW  (If  *0Bl1c»l>lt): 


oiMAcrpurna 

smp  nun  outer _ 

mnro  omkt 

aMBM  OMCT _ 

am.  oia—tbi  muftnor 
oamckxjslt  iwoouatt 
mjo  g  wg 

pen  pggntti  wrr  mruiM. 

UTOI)  CXQS2VCLT  COLO  WTOUM. 

urea  saw  or  tucnic  90a 
UKBCD  MOtlKSt  IX  WTIOM 

ACT  AQCDOATTLT  W1CHLICKTED 
TTgIC  WATPIALiTUClATTOM  OTTACTMU 
AtglMfl  HKTPILAl  COTTACTAH 
SUM  MBSM  AT  OAMODUS  IXTtL 

VliMTIfll  AnmBBBIB  WCTBP - 

FtOTJtUCT 

WMBROULST  lAAOEOUATt  OLUOMniM 
Of  "TTOTTAl  AfflOtHT  SIT1 _ 

OAwg»oun.T  mam  imrmwnow 

UMKOUATI  EQUimOTT  AIKXKIM 
UWX9UATT  AOSOMML  WSTWUff 

WAopuATT  rouimarr  aaqoiiw 
surren  umjum  suina 
sumn  aiitin  si*f  act 
cumin#  surr ACT  without 

uSfm/cflSKA^W^ACi  Wflwi 
mown  woaja 

IMOQJUATt  OIMOftAIU/OMIELDIM 

OAHSBWUS  HAMMA«/SOFrUA*£ 
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GENERAL  INSTRUCTIONS  FOR  PERSONNEL 
SELECTION  MEASURES 


DESCRIPTION:  An  operational  test  (OT)  has  been  completed  recently.  For 
the  specifics  of  this  OT,  see  the  "Task  Evaluation  Worksheet"  of  this 
submission.  Various  operator  and  maintainer  tasks  were  measured  during 
this  OT.  One  or  more  of  these  tasks  was  evaluated  as  having  been  performed 
inadequately. 

Operational  testing  and  evaluation  personnel  have  determined  that  those 
tasks  that  are  listed  are  of  significant  importance  to  the  overall  evalu¬ 
ation  of  the  system  that  was  tested.  They  need  to  know  why  these  tasks 
were  performed  inadequately.  One  possible  reason  is  that  the  individual 
or  individuals  who  performed  inadequately  had  significant  characteristics 
that  interacted  with  the  system  hardware/software  and  that  fell  outside 
the  fifth  to  ninety-fifth  percentile  envelopes  for  the  appropriate  popu¬ 
lation.  In  the  case  of  measures  of  central  nervous  system  functioning, 
one  possible  reason  is  that  the  individual  or  individuals  fell  below  the 
fifth  percentile  for  the  characteristics  in  question. 

It  is  not  necessary  to  take  any  personnel  selection  measures  if  you  can 
be  sure  that  all  the  personnel  who  performed  inadequate  were  "representa¬ 
tive  soldiers"  in  all  their  significant  characteristics.  Being  a  repre¬ 
sentative  soldier  implies  that  these  individuals  fell  within  the  fifth  to 
ninety-fifth  percentiles  for  those  significant  characteristics  which  would 
affect  task  performance.  Since  system  hardware  and  software  were  supposed 
to  be  designed  for  "representative  soldiers"  if  the  soldiers  were  repre¬ 
sentative,  this  could  not  be  the  cause  of  inadequate  performance.  However, 
the  random  selection  of  military  units  to  act  as  players  in  an  OT  does 
not  guarantee  the  representativeness  of  the  soldiers  involved. 


Further,  you  must  deal  with  the  question  of  whether  a  "representati ve 
soldier1'  is  supposed  to  represent  the  specific  military  population,  or 
the  appropriate  age  group  of  the  general  population. 

This  section  includes  a  set  of  "Common  Procedures"  that  applies  to  al 1  of  - 
the  listed  Personnel  Selection  Measures.  If  you  have  also  received  the 
HRTES  HFE  Measures,  you  will  notice  that  the  Personnel  Selection  Measures 
"Common  Procedures"  are  largely  identical  to  the  HFE  Measures  "General 
Procedures"  plus  their  "Common  Procedures." 

Your  first  problem  will  be  to  decide  which  Personnel  Selection  Measures  to 
take  of  each  task  to  be  diagnosed.  During  the  OT,  players  and  observers 
filled  in  questionnaires  in  which  they  gave  their  opinions  of  the  diffi¬ 
culty  of  each  task  and  the  reasons  for  significant  difficulty. 

If  any  player  or  observer  thought  that  performing  a  given  task  was  diffi¬ 
cult  and  that  task  is  one  of  those  being  analyzed  now,  you  will  have  a 
questionnaire  for  it.  In  this  case  the  scale  scores  listed  may  be  helpful 
to  you  in  deciding  which  Personnel  Selection  Measures  to  take.  If  a  score 
indicates  significant  difficulty  (50  or  below),  it  is  reasonable  to  take 
the  corresponding  Personnel  Selection  Measure(s)  for  that  task.  In  some 
cases  several  Personnel  Selection  Measures,  taken  together,  correspond  to 
one  questionnaire.  It  is,  of  course,  possible  that  players  and  observers 
were  not  able  to  judge  whether  there  was  something  which  was  inadequate  and 
produced  inadequate  task  performance.  Therefore  these  scores,  if  they  are 
available,  can  only  be  a  guide  for  you  to  use  as  you  think  best. 

Since  the  scales  of  the  "Opinion  Summary  Data  Worksheet"  and  the  Personnel 
Selection  Measures  do  not  always  equal  each  other  on  a  one  scale  to  one 
measure  relationship,  the  following  table  is  presented. 
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RATING  SCALES 
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NUMBERS  OF  PERSONNEL 
SELECTION  MEASURES 


1. 

Understanding  Procedures 

1+2 

2. 

Display  Readabil ity/Hearabil  ity 
Measurement 

3+4  and/or  5+6 

3. 

Display  Information  Understanding 

1+2 

4. 

Usefulness  of  Display  Information 

None 

5. 

Manipulation  Difficulty 

12+13+14 

6. 

Reach/Accessibility 

7+8+9 

7. 

Control  Configuration 

10+11 

8. 

Decision  Difficulty 

1+2 

9. 

Target/Terrain  Visibility 

17 

10. 

Workstation  Design  for  Visibility 

17 

11. 

Noi  se 

18 

12. 

Motion 

19 

13. 

Ventilation 

20 

14. 

Temperature 

20 

* 

15. 

Workstation  Dimensions 

15 

16. 

Seating 

15 

17. 

Workload 

21 

18. 

Safety 

None 

19. 

Training  Time 

See  Training 

Measures 

20. 

Training  Method 

See  Training 

Measures 

21. 

Practice  Condition 

21 

22. 

Trainer(s) 

See  Training 

Measures 
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You  can  use  these  scale  scores  as  an  aid  in  deciding  which  Personnel 
Selection  Measures  to  take.  However,  you  cannot  use  them  in  place  of 
Personnel  Selection  Measures.  The  reason  for  this  is  as  follows: 

(1)  Scale  scores  are  parallel  to  both  Personnel  Selection 
and  HFE  Measures. 

(2)  If  a  given  scale  score  were  used  to  replace  both  its 
parallel  Personnel  Selection  and  HFE  Measures,  one  would 
not  be  able  to  differentiate  between  Personnel  Selection 
and  HFE  causes  of  inadequate  performance. 

(3)  One  could  use  a  given  scale  score  to  replace  one  of  a 
parallel  measure  pair--if  the  other  parallel  measure 
indicated  no  difficulty,  or  if  the  other  parallel  measure 
were  considered  fixed  and  therefore  not  taken. 

(4)  It  is  considerably  more  likely  that  Personnel  Selection 
will  be  considered  fixed  than  will  HFE.  Further,  personnel 
characteristics  are  more  likely  to  require  specific 
documentation  as  causes  of  inadequate  performance  than 

are  HFE. 

(5)  Therefore,  scale  scores  can  only  be  used  as  replacements 
for  HFE  Measures,  not  Personnel  Selection  Measures,  and 
even  this  replacement  is  discouraged  in  HRTES. 


COMMON  PROCEDURES  (APPLICABLE  TO  ALL  PERSONNEL  SELECTION  MEASURES): 


(1)  Examine  the  questionnaires  for  each  task.  Use  their 
scores  as  an  aid  to  selecting  parallel  Personnel 
Selection  Measures.  If  you  do  not  have  one  or  more  such 
Worksheets,  use  your  best  judgement  for  deciding  which 
measures  to  take  of  each  task. 

(2)  Make  sufficient  copies  of  the  Personnel  Selection  Measure 
Worksheets  so  that  you  have  as  many  as  you  need  for  each 
HPF  to  be  diagnosed. 

(3)  Study  the  characteri sti cs  listed  on  each  worksheet.  If 
you  think  that  a  significant  characteristic  is  missing, 
add  it  in  the  "Other"  category. 

(4)  Decide  if  each  characteristic  on  the  Worksheet  is  relevant 
to  the  performance  of  the  task  being  diagnosed  in  this 
system.  If  it  might  have  a  significant  effect  on  task 
performance  in  this  system,  it  is  relevant.  In  this 

case  record  an  "X"  in  the  appropriate  cell  of  the 
Relevance  Column.  If  a  characteristic  is  not  relevant, 
record  a  "0"  in  the  cell. 

(5)  If  there  is  a  column  for  designating  specific  part  of  body, 
complete  it  for  each  selected  characteristic. 

(6)  Rate  each  characteristics  that  you  have  selected  on  the 
criticality  scale  which  follows.  Select  any  rating  from 
1-100.  Record  the  rating  in  the  appropriate  cells  of  the 
Rating  Column. 
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LOW  CRITICALITY 
1 


25 


MODERATE  CRITICALITY 
50 


75 


HIGH  CRITICALITY 
100 


Just  important  enough  Criticality  moderate  Criticality 

to  be  measured.  Criti-  for  this  task  extremely  high 

cality  low  for  this  task  for  this  task. 

(7)  Obtain  appropriate  measurements  of  each  characteristic 

you  have  selected.  This  may  be  done  in  the  following  ways: 

(a)  Obtaining  appropriate  measurements  from  previous  OT's, 

OT's,  HFE  tests,  or  other  reasonably  reliable  sources. 

(b)  Physically  taking  the  necessary  measurements  from  the 
actual  system. 

(c)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 

(8)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 

(a)  Comparison  with  reasonably  valid  specifications  such 
as  those  found  in  MIL  STD-1472,  HEDGE,  and  HFTEMAN— 
that  is,  of  course,  preferable. 

(b)  Evaluation  based  on  expert  judgment--in  the  absence 

of  an  applicable  standard  your  judgment  may  be  substituted. 

* 

(9)  Remember,  this  procedure  applies  only  to  those  individuals 
who  performed  the  given  task  below  criterion.  If  a  given 
characteristic,  for  one  individual,  falls  inside  the  fifth 

to  ninety-fifth  percentile  envelope,  or  exceeds  the  appropriate 
standard,  or  your  judgment,  assign  (do  not  record)  a  1.  If 
it  does  not,  assign  a  0.  If  only  one  dividual  performed  this 
task  inadequately,  then  the  1  or  0  assigned  that  individual's 


characteristic  is  recorded  directly  in  the  appropriate 
cell  of  the  (0/1)  column.  However,  if  more  than  one 
individual  performed  this  task  inadequately,  you  will 
have  to  compute  the  mean  of  the  zeros  and  ones  for  this 
characteristic.  Once  this  has  been  computed,  record  the 
mean  of  the  zeros  and  ones  assigned  to  the  given  characteristi 
in  the  appropriate  cell  of  the  (0/1)  column. 

(10)  Record  the  source  of  each  comparison  in  the  appropriate 
cell  of  the  Source  Column.  This  should  be  information  as 
to  the  source  of  the  measurement  itself  and  the  standard. 

If  there  is  insufficient  space  to  record  all  the  required 
source  information,  append  a  page  and  use  the  space  to  refer 
to  i  t . 

(11)  Multiply  the  0,  1,  or  mean  for  each  characteristic  by  the 
1-100  rating  of  its  criticality.  Record  the  resulting 
products  in  the  appropriate  cells  of  the  Product  Column. 

(12)  Add  all  the  products,  and  record  the  resulting  sum  in  the 
Product  Sum  Cel  1 . 

(13)  Add  all  the  0  or  1  ratings  in  the  Rating  Column,  and 
record  the  resulting  sum  in  the  Rating  Sum  Cell. 

(14)  Divide  the  Product  Sum  bj£  the  Rating  Sum,  and  muliply 
the  resulting  quotient  by  100.  Record  the  resulting 
product  in  the  Index  Cell.  This  is  the  Index  of  Adequacy 
for  this  measure.  If  the  measures  of  the  significant 
characteristics  just  met  their  standards,  the  Index 
would  be  approximately  100.  The  less  adequate  the 
characteristics  that  are  measured,  considering  their 
criticality,  the  farther  below  100  will  be  the  Index. 


(15)  When  you  have  finished  taking  the  measures  you  have 
selected  for  each  task,  make  as  many  copies  of  the 
"Summary  Worksheet  for  Personnel  Selection  Analysis"  as 
you  need  for  the  tasks  you  have  diagnosed. 

(16)  Record  the  specific  Personnel  Selection  indices  of 
adequacy  for  the  measures  you  have  taken  for  each  task 
being  diagnosed.  This  is  to  be  done  in  the  appropriately 
labeled  boxes  on  the  Worksheets. 

(17)  [f  you  have  not  taken  a  specific  Personnel  Selection 
Measure  for  a  given  task,  record  an  "X"  in  the  appropriate 
box  of  the  Worksheet. 

(18)  Record  the  specific  characteri stic ( s )  which  caused  any 
specific  Index  of  Adequacy  to  be  significantly  below  100. 
This  is  to  be  done  in  the  first  column  of  the  Worksheet. 

If  necessary,  append  an  additional  sheet  for  this  purpose, 
and  reference  it  in  the  first  column. 

(19)  Compute  the  means  of  the  specific  Indices  of  Adequacy 
according  to  the  branching  structure  on  the  Worksheet. 

Means  are  to  be  computed  of  Indices:  1+2;  3+4;  5+6; 

7+8+9;  10+11;  12+13+14;  15-21.  Record  the  resulting 
seven  means  in  those  boxes  to  which  the  branching 
structure  leads.  Next,  comptue  the  means  of  the  following 
means  from  the  previous  step:  (3+4)+5+6)  and  (7+8+9)+ 

10+11 ) +( 12+13+14 ) .  Finally,  take  these  two  newly  computed 
means,  and  compute  the  means  of  the  following:  (1+2; 
(3+4+5+6);  (7-14);  (15-21);  and  (22).  Record  the  resulting 
means  in  those  boxes  on  the  Worksheet  appropriate  for  them. 
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(20)  If  al  1  the  specific  indices  are  absent,  for  a  given 
collective  index,  record  an  "X"  in  the  box  for  that 
collective  index.  If  you  have  recorded  an  "X"  in  any 
individual  box,  leave  it  out  of  the  computation. 

(21)  When  you  have  completed  all  the  Personnel  Selection 
Measures  and  the  "Summary  Worksheet  for  Personnel 
Selection  Analysis"  return  all  materials  to  sender. 


personnel  selection  measure  #2 

APT  I  ruDE/ABI LI TY  THAT  BEARS  ON 
COON! T I  YE  FUNCTIONING  ADEQUACY  WORKSHEET 


TASK: 


CONDITIONS  (If  4ppl  1c*Dle) : 


— <  Q 

CHARACTERISTICS _  3  S  o  £  SOURCE 

READING  APTITUDE/ ABILITY 


V0CA8;iARr  ABILITY 
MATHEMATICS/ NUMERICAL  APTITUDE 


ABILITY _ 

SPATIAL  ORIENTATION 


MEMORIZATION  APTITUDE/ ABILITY 


REASONING  APTITUDE/ABILITY 


PERSONNEL  SELECTION  MEASURE  «8 
JOINT  MOTION  FOR  ACCESSIBILITY  ADEQUACY  WORKSHEET 


TASK: 


CONDITIONS  (If  applicable) : 


CHARACTERISTICS 


ijS  S 

f  .  s 


WRIST  FLEXION 


wrist  extension 


WRIST  ADOUCTIQN 


WRIST  ABDUCTION 


FOREARM  S URINATION 


FOREARM  PRO  NATION 


ELBOW  FLEXION 


SHOULDER  FLEXION 


SHOULDER  EXTENSION 


SHOULDER  ADDUCTION 


SHOULDER  ABDUCTION 


SHOULDER  MEDIAL  ROTATION 


SHOULDER  LATERAL  ROTATION 


ANGULAR  LIMITS  OF  WHOLE  ARM  HORIZONTAL 
MOTION  (SPEC.  HANO  HEIGHT  ABOVE  SEAT) 


ANKLE  EXTENSION 


ANKLE  ADOUCTION 


ANKLE  ABOUCTION 


KNEE  MEDIAL  ROTATION 


Continued  on  Following  Page 


PERSONNEL  SELECTION  MEASURE  #8- -COfiT  'D 


TASK: 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


<  qc  O 

^  O  *  »- 

s  s.  :  -a 

w  —  >-  <  at 

a t  -J  ac  o  Ob 


WEE  LATERAL  ROTATION 


HIP  FLEXION 


HIP  AOOUCTION 


HIP  BREADTH  (STAWIN6) 


HIP  BREADTH  (SQUATTING) 


HANO  BREADTH 


HAHO  THICKNESS 


HANO  LENGTH 


FOR  EARN  OIAN£TER/CIRC(A<FER£NCE 


BICEP  OIAHETER/CIRCUIFERENCE 


THIGH  CLEARANCE 


THIGH  CIRC  INFERENCE 


PERSONNEL  SELECTION  MEASURE  #10 
VISION  FOR  MANIPULATION  ADEQUACY  WORKSHEET 


TASK: 


CONDITIONS  (If  applicable): 


31 


I 


PERSONNEL  SELECTION  MEASURE  #12 
STRENGTH  FOR  MANIPULATION  ADEQUACY  WORKSHEET 

TASK: _ _ _ _ 

CONDITIONS  (If  applicable):  _ _ 


CHARACTERISTICS 


THUMB-INDEX  FINGER  GRASPING 
STRENGTH 


,* 

EXTENOED  INDEX  FINGER  STRENGTH  IN 

FLEXION 

EXTENOED  MIDDLE  FINGER  STRENGTH  IN 

-• 

FLEXION 

GRIP  STRENGTH 


ARM  STRENGTH  PUIAING  STRAIGHT  SACK 
(SPECIFY  ELBOW  FLEXION) 


ARM  STRENGTH  PUSHING  STRAIGHT  FOR¬ 
WARD  (SPECIFY  ELBOW  FLEXION) 


ARM  STRENGTH  MOVING  TO  T>€  RIGHT 
(SPECIFY  ELBOW  FLEXION) 


ARM  STRENGTH  MOVING  TO  TIC  LEFT 
(SPECIFY  ELBOW  FLEXION) 


ARM  STRENGTH  MOVING  UP,  VERTICALLY 
(SPECIFY  ELBOW  FLEXION) 


ARM  STRENGTH  MOVING  OOWM,  VERTICALLY 
(SPECIFY  ELBOW  FLEXION) 


ARM  STRENGTH  M0VIN6  CLOCKWISE 
(SPECIFY  ELBOW  FLEXION) 


ARM  STRENGTH  MOVING  COUNTERCLOCK¬ 
WISE  (SPECIFY  ELBOW  FLEXION) 


LEG  STRENGTH  PUSHING  FROM  SEATED 
POSITION  (SPEC I  FI Y  KNEE  ANGLE) 


LEG  STRENGTH  IN  A  VERTICAL  UPWARD 
PULL 


BACK  STRENGTH  IN  A  VERTICAL  UPWARD 
PULL 


WHOLE  300 Y  STRENGTH  IN  A  VERTICAL 
UPWARD  PULL 


WHOLE  800Y  STRENGTH  [N  A  HORIZON¬ 
TAL  PUSH  (FROM  A  SQUAT) 


WHOLE  800V  STRENGTH  IN  A  HORIZON¬ 
TAL  PUSH  (STAJCING) 


FATIGUE  TOLERANCE  FOLLOW IN&-L0N6 
TERN  USE  OF  REQUIRED  STRENGTH 


SOu,  O 

ZL  at 

*  .  ss  » 


3°  a 


PRDCT 


PERSONNEL  SELECTION  MEASURE  ??I5 
ANTHROPOMETRY  FOR  WORKS TAT  ! ON/ENV I RO 
D  I  MENS  I  ONS  ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


MINIMUM  SQUATTING  HEIGHT 

SQUATTING  HEIGHT  (UPRIGNT) 

VERTICAL  TRUNK  CIRCUMFERENCE  (STANDING 

SUTTOCK-EYE  HEIGHT  (SITTING) 

BUTTOCK-EYE  HEIGHT  (STANDING) 

NECK  FLEXION-LEFT 

NECK  FLEXICN-RIGHT 

NECK  FLEX ION- OORSAL 

NECK  FLEXION-VENTRAL 

NECK  ROTATION- RIGHT 

NECK  ROTATION-LEFT 

ANGLE  OF  SIGHT  AT  EXPECTED 

HEAQ  POSITION  ... 

OTHER: 

PERSONNEL  SELECTION  MEASURE  #16 
ANTHROPOMETRY  FOR  SEATS  ADEQUACY  worksheet 


TASK: _ _ _ _ 

COWITIONS  (If  appllcibl«):  _ 

UJ  »—  • 

o  ac  eo 


SITTIN6  HEIGHT  (ERECT) 

X 

SITTING  HEIGHT  (RELAXED) 

X 

- 

SHOULDER  HEIWT  (SITTING) 

ELBOW  REST  ICIGHT  (SITTING) 

ELBOW-FINGERTIP  LENGTH 

ICAO  LENGTH 

X 

8UTT0CK-  KNEE  LENGTH 

POPLITEAL  HEIGHT 

'  "  j 

BUTTOCK-POPLITEAL  length 

BUTTOCK-HEEL  LENGTH 

FOOT  LENGTH 

g 

BUTTOCK-HEEL  LENGTH  (DIAGONAL) 

■ 

HEAD  BREADTH 

X 

SHOULDER  (8I0aT0I0)  BREAOTH 

X 

FOREARM- FOREARM  BREAOTH 

X 

WAIST  BREAOTH  (SITTING) 

x 

HIP-HIP  8REAOTH  (SITTING) 

X 

THIGH  CLEARANCE  HEIGHT  (SITTING) 

X 

THIGH  8READTH  (SITTING) 

WEE-KNEE  BREAOTH  (SITTING) 

X 

Continued  on  Following  Page 

RATING  SUM 

PROCT 

SUM- 

CHARACTERISTICS 


..a 

s  • 


PtRSONNEL  SELECTION  MEASURE  #lb--CONT'D 
TASK: _ _ 

COFOITIOMS  (1/  4ppl1c4bl«):  _ 


CHARACTER  l  ST  ICS 


SOURCE 


p*. »  1, i  *,l 


U»* 


personnel  selection  measure  #17 

VISION  FOR  WORKSTATION/ENVI RONNMENT  ADEQUACY  WORKSHEET 


TASK: 


COICITIONS  (If  »ppl1ciDl«): 


CHARACTERISTICS 


VISUAL  ACUITY-NEAR  (AT  OISTANCE  FROM 
SIGNIFICANT  PART  OF  WORKSTATION) 


VISUAL  ACUITY- INTERMEDIATE  (AT  OISTANCE 
FROM  ENVIRONMENT  FEATURE) 


VISUAL  ACUITY-FAR  (AT  OISTANCE  FROM 
TARGET) 


VISUAL  DISCRIMINATION  (RETINAL  PER  I PH) 


C  3 

o  a. 


NOTION  SICXNESS/VERTIGO  TOLERANCE  TO 
VIBRATION  OF  APPROP.  Hx  AND  AWLITUOE 


VOLUNTARY  MUSCULAR  CONTROL  TOLERANCE  TO 
VIBRATION  OF  APPROP.  Mx  AMO  AMPLITUDE 


REACTION  TIME  TOLERANCE  TO  VIBRATION  OF 
APPROP.  Hx  AND  AMPLITUDE 


PERCEPTUAL  TOLERANCE  TO  VIBRATION  OF 
APPROP.  Hx  ANO  A*»LITUOE 


COGNITIVE  TOLERANCE  TO  VIBRATION  OF 
APPROP.  Hx  ANO  AMPLITUDE 


FATIGUE  TOLERANCE  FOLLOWING  LONG  TERM 
VIBRATION  OF  APPROP.  Hx  ANO  AMPLITUDE 


WTION  SICKNESS/VERTTGO  TOLERANCE  TO 
ACCELERATION  OF  APPROP.  ONSET /DURATION 


VOLUNTARY  MUSCULAR  CONTROL  TOLERANCE  TO 
ACCELERATION  OF  APPROP.  ONSET/DURATION 


REACTION  TIME  TOLERANCE  TO  ACCELERATION 
OF  APPROP.  OKSET/OURATION 


PERCEPTUAL  TOLERANCE  TO  ACCELERATION 
OF  APPROP.  ONSET/DURATION 


COGNITIVE  TOLERANCE  TO  ACCELERATION  OF 
APPROP.  ONSET/DURATION 


POSTURAL  TOLERANCE  TO  ACCELERATION  OF 
APPROP.  ONSET /DURATION 


COAtiUNICATION  TOLERANCE  TO  ACCELERATION 
OF  APPROP.  ONSET/OURATION 


FATIGUE  TOLERANCE  FOLLOWING  SUSTAINED 
ACCELERATION  OF  APPROP.  ONSET 


PERSONNEL  SELECTION  MEASURE  U21 
PHYSIOLOGICAL  INDICES  OF  WORKLOAD 

tolerance  adequacy  worksheet 
TASK:  _ _ _ _ _ 

C 0(101  TICKS  (If  *pp)1C4bU): _ 


SUMMARY  WORKSHEET  FOR  PERSONNEL 
SELECTION  ANALYSIS 


TASK: _ 

CONDITIONS  (If  applicable): 

ISSUE: 


SPECIFIC  PERSONNEL  CHAR¬ 

SPECIFIC  PERSONNEL 

4  COLLECTIVE  | 

COLLECTIVE 

ACTERISTICS  INADEQUACIES 

SaECTION  INDICES 

INDICES  i 

INDICES 

CONTRIBUTING  TO  INDICES 

OF  ADEQUACY 

1  1 

2 

a 

BACXSROIMO 

*□ 

APTITUOE/ ABILITY 

1  "  “  CDjbrJJT  lOI 

PERSONNa 

SELECTION 

INDEX 


|  anthropometry  for 

YISUAL  DISPLAYS 


s|  1  audition  for  dispute 

51 - 1  ANTHROPOMETRY  FOR 

I _ !  AUDITORY  DISPUTE 

TD 


'  I  oispur 

READABILITY 

-1  □ 

- f _ DISPUY 

WEARABILITY 

-1  □ 


- DISPUTE- 

_r  □ 


LENGTH/REACH  AWTHROPOKTRY 
FOR  ACCESSIBILITY 

JOINT  NOTION  ANTHROPOMETRY 
FOR  ACCESSIBILITY 


9 1 - 1  SIZE  ANTHROPOtCTRY 

1 _ 1  FOR  ACCESSIBILITY 


*□ 

□ 

TO j  )  VISION  FOR  MANIPULATION 

IT  I - 1  ANTHROPOMETRY  for  static 

I _ 1  CHARS.  OF  MANIPUUTION 

T2  (  1  STRENGTH  FOR  MANIPULATION 

131 - 1  RANGE  OF  MOVEMENT  FOR 

1 - r  manipulation 

141 - 1  COORDINATION  FOR 

I _ I  MANIPULATION 


.CONTROL 

ACCESSIBILITY 

□ 


>  STATIC 
CONTROL 

□ 


DYNAMIC 

'CONTROL 

□ 


-CONTROLS - 

□ 


ANTHROPOMETRY  FOR  WORX- 
STATI ON/ENVIRONMENT 


I!m  ]; 

15  1  ]  ANTHROPOMETRY  FOR  SEATING 

20  | - 1  CHARACTERISTICS  ASSOCIATED  . 

I _ I  WITH  VENTIUTION/FILTRATION 


VISION  FOR  WORKSTATION/ 
ENVIRONMENT 

AUDITION  FOR  WORKSTATION/ 
ENVIROWENT 

NERVOUS  ST  STEM  CHARACTERISTICS 
ASSOCIATED  WITH  MOTION 


WORK 

STATION/ 

"ENVIORN-" 

MENT 

□ 


TT 


O 


WORKLOAD  TOLERANCE 
CHARACTERISTICS 


PERSONNEL 

SELECTION 

□ 
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